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COMPTROUJEIR GENERAL OF THE UNITED STATES 



WASHINGTON. D.C. 20S48 



B-200409 



To the President of the Senate and the 
Speaker of the House of Representatives 

This report assesses the progress made in implementing 
and evaluating alternative work schedules experiments as per 
mitted by the Federal Employees Flexible and Compressed VJork 
Schedules Act of 1978. It gives the status of the project 
during the first 18 months of the 3-year experiment and iden 
tifies problems which need to be addressed immediately. it 
also discusses the need for congressional oversight and an 
improved experiment and evaluation to insure the intended 
Djectives are achieved. 

We are sending copies of this report to the Directors, 
Office of Management and Budget and Office of Personnel Man- 
agement; the Chairmen, Senate Committees on Labor and Human 
Resources and Governmental Affairs; and the Chairman, House 
Committee on Post Office and Civil Service. 




Comptroller General 
of the United States 
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COMPTROLLER GENERAL'S THE ALTERNATIVE WORK SCHEDULES 

REPORT TO THE CONGRESS EXPERIMENT: CONGRESSIONAL OVER- 

SIGHT NEEDED TO AVOID LIKELY 
FAILURE 



DIGEST 

More than 250,000 Federal employe ar- 
ticipating in a 3-year, Nation-wi 
tary experiment to determine the e£\ E 
alternative work schedules, and to de\ 
mine whether, and in what situations. 
Federal Government can successfully use 
them. (See pp. 5 and 6.) 

The experiment vas authorized by the Fh..-- 
eral Employees Flexible and Compressed ^ ork 
Schedules Act of 1978. By March 1982, ie 
Office of Personnel Management (OPM) it uo 
report to the President and the Congress on 
the results of the experiment and recommend 
needed legislative and administrative 
actions . 

The law requires OPM to assess the positive 
and negative effects of alternative work 
schedules on 

— the efficiency of Government operations; 
— mass transit facilities and traffic; 
— energy consumption; 
— service to the public; 

— opportunities for full-time and part-time 
employment; and 

— employees ' morale, welfare, and family 
life. 

The Congress authorized the use of alterna- 
tive work schedules with the intent that OPM 
carefully design, control, and evaluate an 
experimental program. OPM has not carried 
out that mandate. (See pp. 2 and 3.) 
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0PM officials told GAO that they lacked suf- 
ficient resources to carry out their man- 
dated responsibilities in the most desirable 
manner. In fiscal year 1979 0PM funded the 
experiment by reallocating budgeted funds 
intended for other activities. For fiscal 
year 1980 the Congress funded less than one- 
half of OPM's $360,000 budget request for 
the work schedules project. As a result, 
0PM did not hire the number of specially 
trained employees which it believed were 
needed to effectively carry out its respon- 
sibilities of establishing and evaluating 
the experiment. 

For example, as of May 1980, the alterna- 
tive work schedules staff consisted of five 
of the 14 employees OPM felt were needed. 
Of the five, only two were trained in re- 
search and evaluation procedures. 

Because OPM did not receive the funding re- 
quested and did not internally reallocate 
the additional funds necessary, it elimi- 
nated some tasks and reduced the scope of 
others. OPM has not 

— reviewed and monitored agencies' work 
schedule plans to insure compliance with 
the act and its program regulations, 

— issued program regulations and guidance 
in a timely manner, 

— provided sufficient training to its coor- 
dinator? and agency alternative work 
schedule coordinators , and 

— developed accurate and reliable statistics 
on the number and type of work schedule 
experiments and the number of work units 
and employees using them. (See pp. 8-10.) 

Because OPM has not performed these tasks, 
GAO believes it lacks the degree of control 
needed to carefulJy manage and evaluate the 
experiment. (See p. 13.) 
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AGENCIES VARY ALTERNATIVE 
WORK SCHEDULES EXPERIMENTS 

Because agencies' functions and missions 
differ, they were allowed to tailor alter- 
native work schedules to their specific 
needs . (See p. 14 . ) 

The methods agencies used to assess the 
feasibility of alternative work schedules 
and to design and implement them varied 
widely. Differences included the 

— degree of employee, union , and individual 
work unit involvement; 

— specific objectives of experiments; and 

— degree of flexibility and freedom of 
choice for employees. (See pp. 14-18.) 

GAO believes these differences affect the 
results of alternative work schedules and 
that 0PM should consider these differences 
in its evaluation. (See p. 10.) 

0PM' s EVALUATION PLAN WILL NOT 
PROVIDE THE NEEDED INFORMATION 

GAO believes 0PM' s master plan for evalu- 
ating the experiment lacks important exper- 
imental control which will flaw the validity 
and reliability of the evaluation results. 
(See pp. 20 and 25 . ) 

Although 0PM is collecting a large quantity 
of information, the data and methods of 
analysis will not provide the valid and re- 
liable information the Congress needs. 
(See pp. 20, 30, and 31.) 

0PM has not: 

— Reviewed individual work schedule plans 
to identify variables which affect exper- 
imental results . 



— Used enough comparison groups to allow 
attribution of specific cause and effect 
relationships . 

— Used scientific sampling procedures which 
would allow projection of findings and 
determination of whether such findings 
are representative . 

— Used methods of analysis which allow con- 
sideration of the effects and interrela- 
tionships of different variables on al- 
ternative work schedule results. 

— Considered the public's views about the 
effects of work schedules on the degree 
and quality of Government service to the 
public . 

— Obtained pre-experimental data on the six 
areas to be studied. (See pp. 24-27.) 

OPTIONS AVAILABLE ' 

GAO believes the current experiment and 
evaluation will fail to provide the Congress 
with the valid and reliable information it 
needs on the positive and negative' effects 
of alternative work schedules and the situ- 
ations under which they may be used success- 
fully. (See p. 30. ) 

Given the status and problems with the cur- 
rent experiment and evaluation, GAO believes 
four options exist. They are: 

— Continue the current experiment and evalu- 
ation without cha.ige, accepting its weak- 
nesses and limitations . 

— Modify the existing experiment and evalu- 
ation to improve the quality of the evalu- 
ation results, while realizing that the 
data may not be representative. 

— Develop a new evaluation approach to max- 
imize the opportunity for providing the 
Congress with the needed data. 
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— Completely stop the alternative work 
schedules experiment . 

GAO believes the first and last options are 
not desirable and advocates development of 
a new evaluation approach as the most desir- 
able option. Although this option may re- 
quire extending the experiment beyond 3 
years, GAO believes it both necessary and 
desirable if the experiment * s objectives 
are to be achieved. (See pp. 30 and 31.) 

RECOMMENDATIOISIS TO DIRECTOR , 
0PM, AND THE CONGRESS 

OPM should: 

— Develop accurate and reliable statistics 
on the number and type of work schedule 
experiments and the number cf work units 
and employees actually using them. 

^~JRe:^jiew a representative sample of vvork 
schedule plans to determine their tech- 
nical accuracy, compliance with the act 
and OPM's regulations, and effects on 
the evaluation results. (See p. 13.) 

— Work with the Congress in assessing the 
adequacy of the current master plan for 
evaluating the alternative work schedules 
experiment. OPM and the Congress must 
agree on (1) specific evaluation objec- 
tives, (2) criteria for measuring the 
attainment of those objectives, (3) costs 
and benefits of various analytical ap- 
proaches, and (4) desired levels of pre- 
cision and confidence. (See p. 32.) 

— Reallocate funds and personnel to allow 
these recommendations to be accomplished 
effectively and timely. (See pp. 13 and 
35. ) 

In considering the adequacy of the master 
plan, OPM and the Congress should assess 
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the need to (1) use scientific sampling pro- 
cedures for projecting findings to the Fed- 
eral work force, (2) analyze and compensate 
for multiple variables affecting alternative 
work schedule results, (3) use more compari- 
son groups, and (4) consider public views 
about alternative work schedules and their 
effects on the degree and quality of service 
to the public. (See p. 32.) 

RECOMMENDATIONS TO THE CONGRESS 

Because of the importance of the experiment, 
and the fact that the Congress will eventu- 
ally have to decide whether to allow the 
permanent use of alternative work schedules 
in the Federal Government, GAO recommends 
that the Congress hold oversight hearings 
to assess the adequacy of 0PM* s master plan. 
In conducting this oversight, the Congress 
should consider the 

— need for, and costs and benefits associ- 
ated with, modifying the existing master 
plan or developing a new one; 

— necessity for extending the 3-year experi- 
ment; and 

— desirability of establishing a joint exec- 
utive agency task force to redesign and 
execute the master plan and to provide 
the needed experimental control. (See 
pp. 31 and 32 • ) 

AGENCY COMMENTS 

0PM said that resource limitations have 
made the job of implementing and evaluating 
the alternative work schedules experiment 
niore difficult. However, 0PM disagrees with 
GAO that the experiment and evaluation will 
not provide the valid and reliable informa- 
tion the Congress needs to determine the ef- 
fects of alternative work schedules and how 
they may be used successfully and permanently. 
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Despite 0PM 's conunents^ GAO still believes 
that the experiment and its evaluation are 
inadequate and that changes are needed- 

This is particularly true in light of the 
possible effect the outcome of the experi- 
ment could have on all Federal employees* 
( See app. V. ) 
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CHAPTER 1 



INTRQDUCTIOISl 

The 5-day, 40-hour workweek with fixed starting and 
quitting times has been the traditional and dominant work 
schedule for the last 40 years. Only in the last 13 years 
have organizations begun experimenting extensively with 
alternatives to the traditional work schedule. These alter- 
natives have, in some cases, only allowed employees flexibil 
ity in selecting starting and quitting times; in other cases 
they have compressed the workweek into some period less than 
the traditional 5 days . 

Although flexible work hours were first introduced by 
a German aerospace company in 1967, the concept was not 
introduced in the United States until 1971. Since then, 
alternative work schedules have become increasingly popular. 
By 1977 about 2.5 to 3.5 million U.S. workers were using 
some form of flexible work schedule and about 2.1 million 
others were using some form of a compressed workweek. 

The reasons for using alternative work schedules in 
the private sector vary. They are believed to be beneficial 
because they: 

— Reduce traffic congestion by shifting commuting pat- 
terns from peak rush periods. 



— Reduce energy consumption . 



— Decrease urban air pollution caused by idling cars 
during rush-hour traffic jams. 

— Increase the use of public mass transit facilities 
and car pools. 

— Increase employee morale and productivity. 

— Allow employees more leisure time. 

Despite these advantages, alternative work schedules 
may also have some drawbacks and present problems and chal- 
lenges for managers and supervisors. For example, alterna- 
tive work schedules may: 

— Make scheduling and planning the workflow more 
difficult . 

— Create timekeeping problems. 
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— Increase energy consumption for heating and cooling 
buildings during additional hours of operation. 

— Make the workday too long and strenuous, which could 
result in decreased productivity and family schedul- 
ing problems. 

— Cause problems concerning office coverage, supervi- 
sion, interdepartmental coordination, and customer 
service . 

Federal Government organizations began using flexible 
work schedules in 1972. By 1977 an estimated 200,000 employ- 
ees (about 7% of the Federal work force) were using some 
simplified form of a flexible work schedule. Although use 
of these schedules generally proved beneficial to both orga- 
nizations and employees, work hours and overtime pay require- 
ments imposed by title 5 of the United States Code and the 
Fair Labor Standards Act impeded experimentation with com- 
pressed and flexible work schedules of more than 8 hours a 
day or 40 hours a week. _!/ 

AUTHORIZING LEGISLATION 

In response to our recommendations and those of the 
Office of Personnel Management (OFM), both Houses of the 
Congress introduced several bills in the early 1970s 
suggesting that the Federal Government experiment more with 
using alternative work schedules. Experimentation was neces- 
sary to determine whether, and in what situations, the Fed- 
eral Government can successfully use alternative work sched- 
ules on a permanent basis. 

The President signed Public Law 95-390, "The Federal 
Employees Flexible and Compressed Work Schedules Act of 1978, 
calling for a 3-year controlled experiment wi^h Federal exec- 
utive agencies _2/ and military departments us .ng alternative 
work schedules. The Public Law is based on t.-e finding that 
new trends in the use of 4-day workweeks, flexible work hours 
and other variations in work schedules in the private sector 



_l/"Benefits from Flexible Work Schedules — Legal Limitations 
"Remain" (FPCD-77-62, Sept. 26, 1977). 

2/ "Executive agencies" means executive departments, Govern- 
~ ment corporations, and independent establishments (exclud- 
ing the U.S. Postal Service and the Postal Rate Commission) 
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appear to show sufficient promise to warrant carefully de- 
signed, controlled, and evaluated Federal experimentation. 
The President also noted in signing the act that: 

"While the advantages appear to be substantial, 
these schedules have not yet been tested within 
the full range of environments that characterize 
Federal employment. Therefore, before making a 
decision to amend Federal law permanently this 
legislation wisely establishes an experimental 
period of 3 years during which we can evaluate 
various innovations in a large number of agencies." 

The purpose of the act is to assess the positive and 
negative effects of alternative work schedules on 

— the efficiency of Government operations; 

— mass transit facilities and traffic; 

— levels of energy consumption; 

— service to the public; 

— opportunities for full-time and part-time employment; 
and 

— employees' morale, welfare, and family life. 

The experiment is made possible by the temporary suspension 
of certain premium pay and work scheduling provisions of ti- 
tle 5, United States Code, and the Fair Labor Standards Act. 
This suspension applies only to agencies or work units par- 
ticipating in an approved alternative work schedule experi- 
ment . 

0PM ' s ROLE 

The act requires 0PM to (1) establish and manage a pro- 
gram for conducting experiments with alternative work sched- 
ules in Federal agencies during the 3-year period that began 
March 29, 1979, and (2) develop and execute a master plan 
for evaluating the experiment. 0PM is to issue a report to 
the President and the Congress no later than September 1981 
recommending any actions needed and stating whether title 5 
of the United States Code and the Fair Labor Standards Act 
should be modified to allow the continued use of both flex- 
ible and compressed work schedules. 
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0PM must also issue a final report, no later than 
March 29, 1982, on the overall results of the 3-year experi- 
ment • 

ALTERNATIVE V?QRK SCHEDULES DEFIISIED 

For purposes of this report, "alternative work sched- 
ules" (AWS) refers to both flexible and compressed work 
schedules. Flexible work schedules (often referred to as 
flexitime) contain two types of time — core time and flexible 
time. Core time is the specified period of a workday during 
which all employees must be present or accounted for through 
use of official authorized leave. Flexible time is the time 
during which employees select their arrival and departure 
times according to constraints management prescribes. The 
only other requirement of flexible schedules is that employ- 
ees must account for the basic work requirement — the number 
of hours they are required to work during a specified period. 

Compressed work schedules allow employees to complete 
the basic biweekly work requirement of 80 hours in less than 
10 full workdays. 

Flexible work schedules 

Although some Federal agencies have been using certain 
types of flexible schedules since 1972, the 1978 act has 
made the use of more sophisticated and innovative types of 
flexible schedules possible by introducing the concept of 
"credit hours." Credit hours are hours employees choose to 
work beyond the specified basic work requirement to shorten 
the length of other workdays or workweeks. At the discre- 
tion of each agency, employees working flexible schedules 
may be permitted to earn and carry over a maximum of 10 
credit hours. The following flexible schedules are being 
used in the experiment: 

Flexitour — employees work 8 hours each day but may 
vary their arrival and departure times only with 
prior notification and approval. 1_/ 

Gliding — employees work 8 hours each day but may vary 
their arrival and departure times daily without prior 
approval . 1^/ 



_l/Although the act permits agencies to allow employees to 
earn and accumulate credit hours for all types of flexible 
schedules, this is an uncommon practice under this type of 
schedule . 



Variable day — employees may vary the length of the 
workday as long as they are present for prescribed 
daily core times and account for the basic work re- 
quirement (40 hours per week). 

Variable week — employees may vary the length of the 
workday and the workweek as long as they are present 
for prescribed daily core times and account for the 
basic work requirement ^80 hours per pay period). 

Maxiflex — employees may elect to work fewer than 10 
workdays during a biweekly pay period since core time 
bands are established on fewer than 10 workdays. 
This is the most liberal of the work schedules and 
has the .characteristics of both flexible and com- 
pressed schedules. For instance, individuals partic- 
ipating in a maxiflex experiment may actually be work- 
ing some type of flexible or compressed schedule or a 
combination of both. (See app. I.) 

Compressed work schedules 

Like flexible schedules, compressed work schedules may 
also take a variety of forms, but provisions for earning and 
accumulating credit hours do not apply. Basically, two 
types of compressed schedules are being used in the experi- 
ment: 

4- day week — employees work 10 hours per day, 40 hours 
each week. Employees have both a daily and weekly 
basic work requirement. 

5- 4/9 — although there are variations of this .>lan, 
the most common approach is where employees are 
scheduled to work 9 hours a day during 8 days of a 
biweekly pay period and 8 hours on the 9th day. Em- 
ployees have both a daily and biweekly work require- 
ment. (See app. I. ) 

SIZE OF THE EXPERIMENTAL PROGRAM 

The AWS experiment has been strictly a voluntary pro- 
gram. Agencies wishing to experiment were permitted to im- 
plement one or more schedules. As of May 1980, 0PM "s AWS 
Research Director estimated that approximately 251,000 Fed- 
eral employees in about 1,100 work units were participating 
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in the voluntary experimental program. 1/ Of the individ- 
uals participating, about 71,000 are using flexible work 
schedules, 130,000 are using compressed schedules, and 
50,000 are using both types* 2/ The estimated number of 
employees experimenting with each type of work schedule 
follows . 



Number of 



Type of schedule 

Flexible : 

Flexitour 
Gliding 
Variable day 
Variable week 
Maxif lex 

Total 

Compressed : 

4- day week 

5- 4/9 



Total 



Mixed : 



Percent of 



18,000 


7.2 


6,000 


2.4 


7,000 


2.8 


5,000 


2.0 


35,000 


13 .9 


71,000 


28.3 


90,000 


35.9 


40,000 


15.9 


130,000 


51.8 


50,000 


19.9 


251,000 


100.0 



Total 

OBJECTIVES, SCOPE, AND METHODOLOGY 

The use of work schedules which allow employees to 
alter the number of hours in a workday or the number of work- 
days in a workweek represents a significant change in Fed- 
eral employees* work patterns. Both the President and the 
Congress believed that carefully controlled AWS experimenta- 
tion was needed before permanently modifying and adopting 
laws to use such schedules. 



1/OPM estimated that more than 251,000 employees from about 
1,400 units may actually be participating in the AWS exper- 
iment; however, the actual number of employees and the 
types of schedules were not available for the 1,400 units. 

2/The act permits agencies to conduct one or more AWS exper- 
iments. Some work units are experimenting with more than 
one type of schedule simultaneously. 
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Our objectives were to (1) identify the progress made 
and problems experienced by both 0PM and selected Federal 
work units in implementing alternative work schedules and 
(2) assess the adequacy of 0PM 's master plan for evaluating 
the experiment. 

Our work included extensive reviews of 0PM 's AWS pro- 
gram regulations and documents and discussions with both 
present and former members of 0PM 's experimental program 
staff. We interviewed managers, supervisors, employees, and 
union representatives from work units within 12 Federal agen- 
cies and military departments in Washington, D.C., and the 
metropolitan areas of Atlanta and Denver. (See app. II.) 
We selected these locations according to the number of agen- 
cies and employees experimenting with different types of AWS 
and to obtain headquarters and regional views about the ex- 
periment. Denver was selected because of the coordinated 
efforts of Federal agencies in using AWS, under the direc- 
tion of the Denver Federal Executive Board's Clean Air Com- 
mittee, to deal with problems of traffic congestion, air 
pollution, and gasoline shortages. 

We also contacted numerous private sector companies 
which have both successfully and unsuccessfully implemented 
AWS. We discussed their evaluation techniques and findings 
and reviewed their evaluation reports. 

In making our assessment, we reviewed each component 
of 0PM' s evaluation in detail and applied generally accepted 
principles of program evaluation from several sources, in- 
cluding "The Design and Conduct of Quasi-Experiments and 
True Experiments in Field Settings." 1/ 



_1/T. D. Cook and D. T. Campbell, "Handbook of Industrial and 
Organizational Psychology" (Rand McNally, 1976), 
pp. 223-326. 
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CHAPTER 2 



DEVELOPMENT AND IMPLEMEMTATIOISl OF THE 

EXPERIMENTAL PROGRAM 

0PM officials told us that from the time the legisla- 
tion \vas enacted, 0PM has lacked sufficient resources to 
effectively administer the AWS experiment. Rather than al- 
locate additional resources, 0PM reduced the scope of the 
experiment's evaluation. As a result, we believe 0PM will 
not accomplish its legislated responsibilities. 

0PM 's IMPLEMENTATION RESPONSIBILITIES 

In assigning 0PM responsibility for establishing and 
managing the AWS experiment, the Congress indicated that the 
experiment should be carefully designed, conducted, and con- 
trolled to adequately test a range of flexible and compressed 
work schedules within agencies performing diverse functions. 
0PM believes that its AWS program gives agencies the flexi- 
bility to design and test varied work schedules most appro- 
priate to their individual needs. At the same time, 0PM 
believes that the experiment is sufficiently structured to 
provide the minimum information needed to evaluate AWS 
effects . 

The 1978 act authorized 0PM to issue program regula- 
tions for agencies' use in designing and implementing their 
experiments. In exercising this authority, 0PM developed 
broad, general regulations which primarily restate the pro- 
visions of the act. The regulations do, however, prescribe 
certain requirements which must be addressed in agencies' 
AWS plans. These include coverage, time accounting methods, 
limitations on the number of compensatory hours which employ- 
ees may choose to earn instead of payment for overtime hours 
worked, holidays for part-time employees using flexible work 
schedules, and required participation in AWS experiments. 

In addition, as required by the act, GPM has developed 
and provided educational materials, technical aids, and other 
assistance to agencies participating in the experiment. 

0PM 's RESOURCES 

The AWS Program Office, which is a component of OEM's 
Office of Compensation and Program Development, was estab- 
lished to develop, administer, and evaluate the AWS experi- 
ment. AWS officials said that, since the legislation was 
enacted, the office has been hampered by insufficient funds. 



8 2x 



As a result, the program office has not had a sufficient 
staff with the necessary skills to effectively perforin its 
legislated responsibilities. Although 0PM originally esti- 
mated that 11 full-time and 3 part-time employees were 
needed to effectively carry out its responsibilities, the 
size of the staff to date has not exceeded 6 full-time em- 
ployees and 1 part-time employee at any one time. 

In fiscal years 1979 and 1980, OPM did not receive the 
requested budget funds for the AWS program. Because the act 
was passed only 2 days before the start of fiscal year 1979, 
funds for the AWS program were not included in OPM's fiscal 
year 1979 budget request. Therefore, OPM reallocated 
? 160, 000 from within its approved budget to the AWS program. 
In May 1979 OPM asked the Congress to provide a supplemental 
appropriation of $200,000, which was to include the $160,000 
to replace the amount reallocated to the AWS program, plus 
an additional $40,000. The Congress denied OPM's request 
and stated that OPM should fund the project through reallo- 
cation of its approved fiscal year 1979 budget. 

For fiscal year 1980, OPM included in its budget a re- 
quest for $360,000 for the AWS program, but was only granted 
$160,000. The Congress denied OPM the additional $200,000 and 
indicated, as it had previously, that OPM had ample flexibil- 
ity to fund the AWS program by reallocating approved budgeted 
funds. At the time of our review, OPM had not reallocated 
the additional $200,000 to the AWS program. Consequently, 
the AWS Program Office's fiscal year 1980 operating budget 
of $160,000 is less than half the amount OPM said it needed 
to effectively develop, manage, and evaluate the experiment. 

Effects of resource deficiencies 

According to OPM officials, limited resources have pre- 
vented OPM from obtaining the number and types of employees 
necessary to effectively design, manage, and evaluate the 
experimental program. As a result, staff members often per- 
form multiple duties for which they have had no prior train- 
ing or experience. For example, at the time of our review 
the staff of five included only two individuals who were 
trained and experienced in designing and conducting research 
and program evaluation. 

An OPM official told us that more employees with exper- 
tise in designing and conducting program evaluation would 
enhance OPM's ability to effectively evaluate the experiment. 
He also said that, if additional funds were available, OPM 
could possibly hire one or more contractors to conduct or 
assist in analyzing portions of the evaluation. 

9 
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According to 0PM officials, the lack of funds and per- 
sonnel has forced 0PM to place priorities on its tasks, re- 
duce the scope of certain tasks, and eliminate others. It 
has also resulted in 0PM not ' 

— accurately determining the number of AWS participants, 

— reviewing agencies* work schedule plans to insure com- 
pliance with the provisions of the act and program 
regulations , 

—issuing program regulations and guidance timely, and 

— providing sufficient training to 0PM and agency AWS 
coordinators . 

A gency notification forms contain errors 

Initial 0PM guidance indicated that agencies were re- 
quired to begin experiments between March 29, 1979, and 
October 1, 1979. Those agencies or work units wanting to 
participate were required to submit an AWS Notice of Intent 
to Experiment form. On the basis of those forms, 0PM al- 
lowed agencies to initiate desired work schedules. 

0PM has relied on the notification forms as its primary 
source of statistics regarding the number of AWS experiments 
and the total number of employees participating in the pro- 
gram. These forms have also been used to select agencies 
and work units for various parts of the evaluation. 

Our review of the forms disclosed that some did not con- 
tain all of the requested information, and many contained 
errors and discrepancies. We found instances where employ- 
ees participating in an experiment were counted more than 
once because both an agency and work unit submitted a notifi- 
cation form. In addition, some agencies indicated the number 
of employees within the organization rather than the number 
actually participating in the experiment, and some work units 
submitted more than one notification form which resulted in 
multiple counting of the experiment and number of employees. 

0PM officials said they were aware of inconsistencies, 
and during our review they initiated a program to verify the 
information. 0PM hopes to identify and correct all errors 
and discrepancies before the end of the experiment. Conse- 
quently, it can only estimate at this point the number of 
employees and work units participating and the number and 
types of different work schedules being used. We believe 
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that these inconsistencies ir.ust be corrected now so that the 
experiment can be evaluated effectively to produce valid, re 
liable, and representative data* 



We believe there is also a technical error in CPM ' s 
methodology for determining the number of employees using 
flexible work schedules. OFM considers all employees within 
a unit using a flexible work schedule as experimental partic 
ipants . In our opinion, this is inaccurate for purposes of 
evaluation because many of those individuals may still be 
actually working a traditional 8-hour day, 40-hour workweek. 
For example, although one agency's Notice of Intent to Ex- 
periment form indicated that approximately 5,500 employees 
would participate in a flexible (maxiflex) schedule, about 
50 percent of them are still working the traditional work 
schedule . 

Individual work schedule 
plans contain errors 

Agencies and work units were not required to submit 
their individual work schedule plans to 0PM for approval. 
0PM officials indicated that, although review and approval 
of the work plans would have been best, they simply did not 
have sufficient resources to do so. They also indicated 
that they were aware that some of the plans may not conform 
to the provisions of the act or to their regulations. For 
example, they cited a few instances where work units, even 
though not required to do so, actually submitted their work 
schedule plans. In reviewing those plans, 0PM found that 
some contained incorrect information and did not conform 
with 0PM regulations. In those instances, 0PM notified the 
units that their plans should be corrected. 

0PM admitted that many plans may contain errors and dis 
crepancies which could go undetected throughout the experi- 
ment. Thus, in executing its master plan, 0PM may be analyz 
ing and evaluating the results of experiments which have not 
been properly designed or implemented. This raises serious 
questions about the experimental results. 

0PM guidelines have not been timely 

OPM's regulations and many of its written guidelines 
were issued well after most agencies began their AWS exper- 
iments. An 0PM official admitted that the regulations and 
guidelines should have been issued by March 29, 1979, the 
date agencies were allowed to begin their experiments, or 



as soon after that date as possible. The final regulations 
were not issued, however, until November 30, 1979, and other 
guidance was not provided until even later. 

As of July 1, 1980, 0PM had still not issued Book 620 
to the Federal Personnel Manual Supplement 990-2. The book 
gives information on issues such as pay, leave, holidays, 
and work hours — information that agencies should have had 
when they first designed and implemented their AWS experi- 
ments. 0PM officials said that primarily internal delays 
in reviewing and approving regulations and guidelines have 
delayed their issuance . 

Many work units we reviewed did not have a complete set 
of 0PM* s guidance materials. Many officials had no idea 
which, if any, documents they had not received. For example, 
at the time of our review, officials at several work units 
were unaware that 0PM 's final AWS regulations had been issued. 

The lack of written guidelines caused confusion among 
agencies in implementing their AWS. As a result, some 
either chose not to participate in the experiment or to de- 
lay beginning their experiments until 0PM 's regulations and 
guidelines were issued. Most agencies began their experi- 
ments even though they did not have all the necessary infor- 
mation. 

Lack of sufficient AWS training 

Individuals designated by agencies to serve as AWS coor- 
dinators are the focal points for agencies' and work units' 
AWS programs. They serve as liaisons between 0PM and agen- 
cies and are the main source of information for questions 
pertaining to AWS. 

The AWS coordinators we contacted had varying amounts 
of knowledge and previous experience with varied work sched- 
ules. 0PM originally planned to provide extensive training 
to insure that such individuals were knowledgeable about the 
mechanics of the experiment. However, the training actually 
provided was very limited. The 0PM coordinators only re- 
ceived two briefings on the experijnental program, of which 
1 day was spent on the provisions of the act and half a day 
on data collection. Agency coordinators did not receive any 
training. Therefore, for the most part, coordinators had to 
learn about the mechanics of the experiment on their own. 
They told us they learned this by primarily reviewing and 
referring to the law and to 0PM' s written guidelines. But, 
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as discussed previously, these individuals may not have re- 
ceived all of 0PM' s guidelines. Therefore, they were not 
always prepared to provide necessary and accurate assistance. 

CONCLUSIONS 

0PM has not carried out its legislated implementation 
responsibilities in the most desirable manner and is not ex- 
ercising the degree of control needed to effectively imple- 
ment, manage, and evaluate the experiment. OPM does not (1) 
have accurate information on the number of employees and 
work units participating in the experiment and the types of 
schedules being used and (2) know whether experiments h=*"o 
been developed and are being implemented according to v ^ 
provisions of the act and OPM's regulations and guidelines. 
OPM must correct these problems if it intends to evaluate 
the AWS experiment effectively and if the experiment is to 
meet the intended objectives. 

RECOMMENDATIONS TO DIRECTOR, OPM 

We recommend that OPM make a concentrated effort now to 
correct the deficiencies affecting the AWS experiment. It 
is essential that accurate information be developed on such 
things as the actual number of employees using alternative 
work schedules (that is, other than the traditional 8-hour 
day, 40-hour workweek) , the number of experiments being con- 
ducted, the number of different types of work schedules being 
used, and the number of employees using each type of schedule. 

We also recommend that OPM review a representative 
sample of work schedule plans to detect errors and to iden- 
tify different design and implementation methods and varia- 
bles which affect AWS results. 

If additional funds and personnel are needed to perform 
these functions, we recommend that OPM reassess its priori- 
ties and, to the extent possible, reallocate internal 
budgeted funds to the AWS Program Office. 



13 



CHAPTER 3 
DEVELOPMENT AND IMPLEMENTATIOIQ OF 



AGENCIES' WORK SCHEDULES VARIED 

At the time the legislation was enacted, both the Con- 
gress and 0PM were concerned that the number of executive 
agencies volunteering to experiment with AWS may not include 
enough positions and types of work schedules to allow a con- 
trolled experiment and evaluation. Testing a variety of 
work schedule innovations within the full range of environ- 
ments that characterize Federal employment is critical be- 
fore drawing conclusions about the effects of AWS and about 
the desirability of using it permanently. As it turned out, 
about 250,000 employees from approximately 1,100 work units 
volunteered and implemented a variety of AWS experiments. 
These work units represent a diversity of types and sizes 
of organizations, geographic locations, functions, and ac- 
tivities . 

Recognizing the uniqueness and differences of agencies 
and work units,' both the act and OPM ' s regulations made them 
responsible for assessing the feasibility of AWS, selecting 
the type of AWS, and designing and implementing AWS. The 
purpose was to allow agencies and work units to tailor their 
experiments to their particular work environment and objec- 
tives. The only requirement was that the experiment be de- 
veloped and administered according to the act and OFM's 
regulations and guidelines. 

The methods used to assess the feasibility of AWS and 
to design and implement it varied widely. We agree that al- 
lov:ing agencies and work units the flexibility to assess, 
design, and implement AWS is desirable. Such an approach 
allows organizations to tailor AWS to their specific needs 
and objectives. However, the procedures used in carrying 
out these responsibilities must, in our opinion, be consid- 
ered in evaluating AWS. The success or failure cf AWS can 
be affected by the extent of, and the methods used in, plan- 
ning it. The same AWS may yield different results if the 
methods used to assess, design, and implement it differ, 

METHODS OF ASSESSING WORK 
SCHEDULE FEASIBILITY VARIED 

To assist organizations in assessing the feasibility of 
using AWS and in designing and implementing it, OPM developed 
the Alternative Work Schedules Implementation Guide. This 
guide was issued in March of 1979 and was to be provided to 
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all AWS coordinators and individuals requesting a copy. It 
emphasizes careful planning as the key for successfully de- 
signing and implementing AWS which meets the needs of both 
employees and the organization. The guide further stresses 
that whether or not an organization establishes a committee 
to assess the feasibility of using AWS, "communications with 
and input from managers, supervisors, employee unions and 
employee groups is imperative. A lack of communication can 
only lead to serious problems once the project is imple- 
mented." We agree with 0PM, and our research of success- 
fully implemented AWS by private sector companies supports 
this contention. Almost invariably the successful private 
sector AWS experiments we reviewed were characterized by 
employees* involvement in assessing the feasibility of, 
designing, and implementing AWS. 

This involvement is important as an aid in eliminating 
employees* perceptions that the specific AWS was designed 
by management to meet its own needs. If not viewed as being 
beneficial to the employee and organization, AWS may be 
destined for failure. In this regard, we agree with 0PM* s 
view that it is also important for firstline supervisors to 
be included in assessing the feasibility of and designing 
AWS because their support is essential to successful imple- 
mentation . 

We found that the methods of assessing the feasibility 
of AWS varied markedly. Officials at most agencies and work 
units we visited indicated that they had either never re- 
ceived the implementation guide or received it too late to 
be useful. Others were not even aware that the implementa- 
tion guide existed, and some who did receive the guide never 
used it. 0PM officials said that, although the guide was to 
be provided to all agencies, they were not certain whether 
all agencies had actually received it and whether the guides 
were distributed throughout organizations. 

Most agencies delegated the responsibilities for assess- 
ing, designing, and implementing AWS to individual work units. 
The methods used to carry out these responsibilities included: 

— Unilateral decisions by agency headquarters management. 

— Unilateral decisions by management of individual work 
units within agencies. 

— Supervisor preference votes. 

— Employee preference votes. 
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— Planning committees or task forces with management, 
supervisor, employee, and union representation, if 
applicable . 

We believe it essential that 0PM take steps to consider 
them in evaluating the overall AVvS experiment. The degree 
of planning and employee involvement may affect the success 
or failure of AWS . 

PROCEDURES TO DESIGN AMD ADMINISTER 
WORK SCHEDULES ALSO DIFFER 

In issuing its regulations and guidelines, 0PM recog- 
nized that one specific AWS with the same requirements would 
probably not work for all individuals and units within an 
agency. Therefore, it encouraged agencies to establish 
general policies and procedures for AWS and to make work 
units responsible for designing and implementing it to suit 
their own needs. 



While most agencies allowed work units to decide whether 
to participate in the experiment, the degree of work unit 
participation in designing and implementing AWS varied. At 
one extreme, agencies (headquarters level) designed AWS and 
simply gave work units specific requirements to follow. 
Other agencies gave field offices and work units the respon- 
sibility for developing the entire program, including poli- 
cies and procedures. 

Within these two extremes, we found instances where: 

— Agencies' headquarters were involved initially in as- 
sessing tne feasibility of experimenting with AWS, 
identifying the work units interested in experiment- 
ing, and determining which type of AWS would be used. 
The design and implementation of AWS was then as- 
signed to the work unit, and headquarters only became 
involved if a major policy question or problem arose. 

— Agencies' headquarters completely designed AWS but 
allowed work units to make slight procedural modifica- 
tions to suit their individual work unit or employee 
needs . 

The degree of flexibility in designing and implementing 
AWS also varied within individual work units. We found in- 
stances where individual branches, offices, or even supervi- 
sors within work units were allowed to design plans and regu- 
lations to meet their own needs. Such situations generally 
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occurred when the unit was physically isolated from the rest 
of the organization and had little or no interunit communica- 
tions ♦ 



Agencies and work units also had different philosophies 
on what should be included in their AWS plans. Some pre- 
pared very detailed AWS plans and regulations, while others 
developed general plans which only restated the provisions 
of the act and 0PM regulations. In some instances written 
plans were not developed so that supervisors and employees 
within individual work units could tailor AWS to their par- 
ticular needs. 



PROGRAM REQUIREMEISITS VARY 
BY AGENCY AND WORK UNIT 



Because of the degree of discretion allowed in design- 
ing and implementing AWS, employees from different agencies 
or work units using the same type of AWS have different re- 
quirements to follow and varying degrees of flexibility. 
For instance, the act stipulates that, subject to 0PM or 
agency regulations, individuals using flexible work sched- 
ules can carry over as many as 10 credit hours from one bi- 
weekly pay period to another. However, the act also allows 
agencies to restrict the use of credit hours if the agency 
is being disrupted in carrying out its functions or is in- 
curring additional costs . Consequently , some employees 
using the same AWS may be prohibited from earning credit 
hours; restricted on the number of credit hours they can 
earn; and restricted on when, within what time frames, and 
how earned credit hours can be used. In our opinion, each 
of these variables could affect AWS results. 



As indicated in 0PM' s draft of Book 620 ("Alternative 
Work Schedules") to the Federal Personnel Manual Supplement 
990-2 , agency guidelines , groundrules , and limitations for 
AWS comprise an important part of the experimental program; 
thus, supervisor and employee understanding of them is vital 
to the program's success. Other policy matters agencies 
could incorporate, which might affect evaluation of AWS, 
include decisions on whether to: 



— Exclude certain employees from the experiment because 
of the nature of their positions, unusual demands, or 
personal hardships. 

— Require employees who are participating in the experi- 
ment to work • specif ic hours during flexible time bands 
on a temporary or irregular basis. 
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— Permit employees freedom to choose starting and quit- 
ting times within the tour of duty established by the 
agency, with or without prior supervisory approval; 
require employees to select one of several predeter- 
mined tours; or require employees to submit a sched- 
ule in advance for approval. 

— Require employees to inform their supervisors, in 
advance, of intent to earn or apply credit hours to 
their basic work requirement. 

— Permit employees to occasionally apply credit hours 
to core time bands with a supervisor's prior approval, 
although such hours would normally be applied only 
to flexible time bands. 

— Permit employees to change their approved work sched- 
ules at various time intervals throughout the experi- 
ment; a specific number of times per year; or daily, 
weekly, or monthly. 

CONCLUSIONS 

We believe that numerous variables can affect AWS re- 
sults. These include the: 

— Methods used to assess the feasibility of experiment- 
ing with AWS . 

— Manner in which a specific AWS is selected, planned, 
and implemented . 

^ — Degree of employee and union involvement in planning, 
selecting, designing, and implementing AWS. 

— Specific objectives of AWS. 

— Degree of flexibility provided employees. 

— Degree of management and supervisor support of AWS. 

Each variable must, in our opinion, be considered in assess- 
ing AWS effects and is essential in a controlled experiment 
and evaluation. 

Because 0PM did not monitor agencies and work units in 
selecting, planning, and implementing AWS, it does not know 
whether AWS programs have been designed and implemented ac- 
cording to the 1978 act and 0PM regulations. Additionally, 
because agencies did not use uniform procedures in assessing. 




designing, and implementing AWS, it is likely that these 
differences will affect the experiment and evaluation re- 
sults. Consequently, v/e believe that 0PM will not be able 
to validly and reliably assess the effects of AWS since it 
will not know whether the experimental results have been 
caused by the types of schedules or the methods by which 
they were designed and implemented. 
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CHAPTER 4 

0PM 's EVALUATIOtj OF THE AWS EXFERIMEtjT — 



STATUS AND PROBLEMS 

The most important aspect of the 3-year AWS experiment 
is 0PM' s overall evaluation. The evaluation must be con- 
ducted in a manner that wxll produce valid and reliable in- 
formation. Otherwise, the experiment will end and the Con- 
gress will know no more about the effects of AWS and the 
desirability of permanently adopting it than when the exper- 
iment began. 

0PM has developed and is currently implementing a master 
plan for evaluating the AWS experiment, which will result in 
the collection of a large quantity of data. However, 0PM must 
overcome inherent weaknesses (see pp. 24-27) in the way the 
data is being gathered and analyzed before it can provide the 
kind of information the Congress needs. If the evaluation is 
not modified, the intended objectives of the experiment will 
not be achieved. 

In developing and enacting the 1978 act, the Congress 
recognized that the potential advantages of AWS probably 
cannot all coexist. For instance, while spreading out rush 
hour may lead to some energy savings through reduced traffic 
congestion, keeping Federal buildings open for longer hours 
may actually increase energy consumption. Because competing 
benefits and costs must be assessed, the act wisely mandated 
a closely monitored and evaluated 3-year experiment. How- 
ever, this is not presently being accomplished. 

A particular type of flexible or compressed work sched- 
ule might be a resounding success in one agency or work unit 
and a dismal failure in another. Numerous variables can and 
do influence the effects of AWS, such as the manner in which 
it is implemented, the degree of employee and union partici- 
pation, the degree of f lexibili- y afforded employees, time- 
keeping procedures, geographic setting, organizational size, 
type of work performed, availability of transportation facil- 
ities, and the goal of the experiment itself. In evaluating 
the effects of various AWS, 0PM is not identifying, measur- 
ing, and adjusting for such variables. 

To be successful, 0PM' s evaluation and reports to the 
Congress must provide, to the extent possible, concrete evi- 
dence which will help decide the Federal Government's future 
approach to alternative work schedules. The evaluation 
needs to be valid and reliable to minimize the public s 

20 33 



perception of AWS as just another boon for Federal employees, 
with a negative effect on taxpayers. The evaluation is also 
of particular importance to the private sector since the re- 
sults may well determine whether Federal labor laws will be 
modified to allow companies to use more complex forms of 
flexible and compressed work schedules. 

0PM 's LEGISLATED ROLE 

Section 4(b) of the Federal Employees Flexible and Com- 
pressed v;ork Schedules Act of 1978 required OPM to establish 
by June 27, 1979, a master fllan for studying and evaluating 
AWS experiments conducted under the act. The master plan is 
to provide for the study and evaluation of AWS experiments 
within a sample of organizations of different sizes, geo- 
graphic locations, and functions. It is also to include pro- 
cedures for evaluating a sample of experiments sufficient to 
(1) gauge the effects of flexible and compressed work sched- 
ules on the six impact areas identified in the law (see p. 3) 
and (2) determine whether, and in what situations, the Fed- 
eral Government can successfully use AWS. 

The Congress has recognized the need to test and evalu- 
ate different types of AWS in diverse work environments. 
The joint report of the Senate Committees on Governmental 
Affairs and Human Resources stated that 

★ ★ ^j^g Committees envision a broad-based 
experiment touching several hundred units of 
the Federal Government in order to derive some 
useful data about flexible (i.e., alternative) 
work schedules. * * ★ experiments with units per- 
forming diverse functions are essential * * * 
and a limited experiment could produce results 
that were seriously skewed." 

OPM's MASTER PLAN 

Although OPM was to have developed its master plan by 
June 27, 1979, the plan was not ready until April 14, 1980. 
According to an OPM official, this delay was caused by a 
lack of sufficient resources and the extensive OPM and labor 
union review processes and approvals which were required. 
Although the final master plan is similar to an interim plan 
which was published for comment in the Federal Register on 
July 20, 1979, key differences exist which, in our opinion, 
will seriously affect the evaluation. 



21 



34 



0PM' s current evaluation approach differs in both con- 
cept and scope from the approach that was outlined in the in- 
terim master plan published in the Federal Register in July 
1979. The revisions to the master plan primarily focus on 
the types of data to be collected, the extent of data collec- 
tion, and the methods of analyzing the collected data. The 
result of these changes is collection of data which may not 
be representative and the failure to consider the impacts 
and interrelationships of variables which affect AWS . 

These changes were made primarily for two reasons. 
First, because the number of work units participating in the 
AWS experiment was much larger than originally expected, 0PM 
no longer felt it necessary to include all units in the lon- 
gitudinal and cross-sectional study. Second, 0PM modified 
the evaluation approach to make it more manageable given the 
resources available. In addition, because the size of the 
longitudinal study was reduced, 0PM determined that it would 
be necessary to alter one of the methods of analyzing the 
collected data. Since it is too early to assess the valid- 
ity and accuracy of the actual effects of AWS, we concen- 
trated on assessing the strengths and weaknesses of 0PM s 
evaluation approach. 

The current master plan (see apps . Ill and IV) provides 
for evaluating AWS through four types of studies: 

—A longitudinal and cross-sectional study of a sample 
of experimenting work units. 

— Onsite studies conducted by the 0PM staff which focus 
on AWS effects on the six impact areas. 

--A special study on the net energy impact of AWS. 

Narrative evaluation reports which will be prepared 

by each experimenting work unit not included in the 
longitudinal, onsite, and energy studies. 

Number and types of studies 

The original master plan provided for evaluating AWS ef- 
fects through a broad-based, longitudinal and cross-sectional 
study, and intensive special case studies. The longitudinal 
study, which was essentially the same in structure and con- 
cept as the current version, differed in that it encompassed 
all organizations participating in the AWS experiment rather 
than the 70 which are currently included. The 70 were Dudg- 
mentally selected. 
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The original study included a design for segmenting the 
overall sample using a combination of variables. These vari- 
ables included three levels of organizational size, three 
categories of functions and activities, two levels of geo- 
graphic region, two levels of locale, and four types of work 
schedules. The result was a complex factorial design which 
would have considered 144 possible combinations of variables 
and their effects on AWS. The present design is a simple 
one-way classification using four categories of schedules. 
(See pp. 58 and 59. ) 

0PM cpriginally proposed to conduct intensive special 
case studies which would have involved 50 to 75 work units. 
The scope of these studies differed from the present onsite 
studies mainly in the kind and extensiveness of data that 
would be collected. Each of the studies would have entailed 
collecting extensive data on the effects of AWS used by the 
organization on one particular impact area. Some of the pres- 
ent onsite studies, while not as extensive as the special 
studies, are designed to evaluate the effects of AWS on more 
than one impact area. Also, some of the present studies in- 
clude control groups which are not participating in the ex- 
periment. We believe these are particularly desirable fea- 
tures since there may be tradeoffs in using AWS, and control 
groups allow AWS effects to be identified more definitively. 

In addition to the extensiveness of the data collected, 
the special studies also differed from the present onsite 
studies in that 0PM would have been greatly involved in the 
actual development and implementation of the work units' AWS 
experiments. Such an approach may have provided the oppor- 
tunity, under a controlled situation, to show that AWS should 
be designed and implemented to achieve certain desired goals 
or benefits (e.g., increased service to the public). Under 
the current onsite studies, 0PM will focus on identifying 
problems and benefits in planning, implementing, and func- 
tioning under AWS. The manner in which AWS was implemented, 
the specific AWS objectives, and the parameters within which 
AWS is administered are not presently a focus of either the 
onsite or longitudinal studies. 

The current requirement — that all work units not partic- 
ipating in the longitudinal, onsite, and the special energy 
studies must prepare narrative reports evaluating their AWS — 
was not included in the original master plan. We believe* 
these reports have potential for generating much evidence 
concerning the effects of AWS, but only if OPM provides 
enough guidance on how evaluations should be conducted and 
reports prepared. The focus needs to be on obtaining compar- 
able data which allows aggregation and comparative analysis. 
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Analytical methods 



The analytic process of the present master plan differs 
from the original plan primarily in one respect. While h< th 
plans provide for the use of descriptive statistics and 
trend analysis, the present master plan also provides for 
analysis of variance, whereas the former plan provided for 
multiple regression, including analysis of variance. Multi- 
ple regression would allow 0PM to determine the importance 
and interrelationships of various factors which influence 
the success or failure of an organization's AWS . The analy- 
sis of variance is not an appropriate technique for assessing 
the effects of variables which influence AWS as envisioned 
in the original master plan design. 

In short, in evaluating AWS it is necessary to identify, 
analyze, and adjust for variables before measuring the ef- 
fects of AWS. Regression analysis allows the effects of 
these variables to be considered jointly, in various combina- 
tions, and individually; however, regression analysis, in 
this case, requires a fairly large sample to obtain reliable 
results. 1^/ 

0PM is currently using analysis of variance because it 
is only sampling enough cases to make inferences about the 
effects of four types of AWS. This approach will not allow 
0PM to determine the effects of multiple variables on AWS. 
Consequently, 0PM will not be able to validly and reliably 
identify the positive and negative effects of AWS and the 
situations under which it may be successfully used. 

SPECIFIC ISSUES AND CONCERNS 

As recognized by 0PM in the master plan, the data col- 
lected in the AWS experiment must be analyzed and condensed 
in a manner which aids its comprehension and interpretation. 
This is particularly critical to the AWS project, since the 
purpose of the experiment and the evaluation is to provide 



_l/Various "rules of thumb" have been proposed for relating 
~ sample size to the number of variables in a multivariate 
analysis. A former president of the Royal Statistical 
Society, Sir Maurice Kendall, prefers 10 cases for each 
variable; others allow as few os 5, and still others set 
the minimum at 25. Adopting Kendall's rule, 1,440 cases 
would be needed to satisfy 0PM 's original factorial design 
of 144 combinations of variables. 
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concrete evidence on which to base policy decisions and leg- 
islative action- It is especially important, in our opinion 
to assess the impacts and interrelationships of as many en- 
vironmental and organizational variables as possible, so 
that the true effects of AWS can be measured. 

We are specifically concerned with each of the follow- 
ing individual aspects of 0PM' s current master plan. 

Overall approach 

We believe 0PM' s current master plan lacks important 
experimental control. The lack of control will flaw the 
validity and reliability of the experimental results. The 
most fundamental area in which this lack of control can be 
seen is in the basic design of the AWS experiment itself. 
Had 0PM conducted a "true" scientific experiment, it would 
have exercised tight control over the design of the AWS pro- 
grams; randomly assigned units to various types of program 
formats, including a no-program control condition; developed 
standardized measures and instruments for assessing program 
outcomes; and established controls to insure that the meas- 
ures and instruments were uniformly applied, both before and 
during the program. Each of these elfements of a true experi 
ment is designed to control factors which have consistently 
created ambiguity, controversy, and errors in the interpreta 
tion of research results. 

Instead of controls such as these, we found that: 

— Only in a few instances has 0PM reviewed work units' 
AWS plans. Therefore, in evaluating AWS effects, 0PM 
will not know whether che plans comply with the pro- 
visions of the 1978 act and 0PM' s program regulations 
Additionally, by not reviewing the plans and their ad 
ministration, 0PM may be overlooking key variables in 
assessing AWS effects. For example, the degree of 
flexibility afforded individuals may affect their 
views toward AWS. Also, certain AWS may be success- 
ful from employees' views, but a failure from manage- 
ment's view if the organization's intended objectives 
are not being met. 

— Comparison groups, composed of work units not partic- 
ipating in the AWS experiment, are not being used 
enough. By carefully selecting work units which are 
operating under the same or similar environmental and 
organizational variables, 0PM would be in a better 
situation to attribute specific results to AWS. Ad- 
ditionally, nonparticipants ' views are extremely 
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important since they may be adversely affected by 
other individuals and work units using AWS. 

-0PM is not considering the public's views in assessing 
the effect of AWS on quality of service to the public. 

-0PM has not used any specific scientific procedures 
for selecting work units to be incorporated in the 
longitudinal, onsite, and special energy studies. 
0PM subjectively selected units which met certain pre- 
determined criteria and variables. Consequently, it 
is gathering and analyzing information which may not 
be representative of the Federal work force. 

-0PM lacks reliable information on the types of AWS 
being used and the number of work units and employees 
using them. In reviewing 0PM' s master lists of par- 
ticipants and individual work unit's notifications of 
intent to participate in the experiment (see ch. 2), 
we found some listings contained the same work units 
more than once, wrong listings of the types of AWS 
being used, incorrect numbers of employees actually 
using AWS, and some cases where a unit or even an 
agency participating in the experiment was not in- 
cluded on the master listing. 

-0PM, on several occasions, extended the deadline for 
participating in the experiment. Although October 1, 

1979, was the initial deadline, 0PM still was allow- 
ing work units to begin experiments as late as April 

1980. Consequently, the total number of work units 
and employees participating in the experiment contin- 
uously changed. This complicates sampling procedures 
because the population is not a fixed number. 

-In conducting its evaluation, 0PM, for the most part, 
is not considering and compensating for certain vari- 
ables which need to be considered. These include the 
reasons for implementing a specific AWS; the degree of 
emp? ^yee and union participation in selecting, design- 
ing, and implementing AWS; the degree of employee flex- 
ibility; the impact of varied timekeeping procedures; 
restrictions on earning and using credit hours for 
those using flexible schedules; child care availabil- 
ity; and modes and availability of transportation for 
commuting to and from work. Additionally, 0PM is not 
considering or compensating for the possible effects 
of work units beginning experiments at different times 
Work units which began experiments after others may 
have benefited from other units' experiences. 
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Longitudinal and cross-sectional study 



If developed and administered properly, we believe an 
employee survey which is both longitudinal and cross- 
sectional would have been an excellent vehicle for measuring 
employees' and supervisors' reactions to AWS . OPM's study 
is not truly "longitudinal," however, because no attempt is 
being made to identify respondents (e.g., through the use of 
code numbers). CPM is not considering the fact that the 
makeup of Federal work units is not static. Therefore, even 
though the same number of respondents may complete an em- 
ployee questionnaire at all four points in the administra- 
tion process, the changes in attitudes of the same respond- 
ents will not be known. OPM's approach does not consider 
or compensate for those individuals who leave a work unit 
and are replaced by others with opposing views concerning 
AWS. Other weaknesses include the following: 

— Because agencies were permitted to begin AWS experi- 
ments before the master plan was finalized, 0PM was 
unable to obtain pre-experimental responses from most 
individuals who are included in the "longitudinal" 
study. Consequently, CPM will not be able to reli- 
ably assess how attitude about the six impact areas 
changed as a result of implementing AWS. 

— The AWS questionnaire was designed with the intention 
of collecting pre-experimental data. After missing 
the opportunity for collecting this data, 0PM did not 
redesign the questionnaire. We believe this is essen- 
tial because the questionnaire uses indirect questions 
and in many cases does not address specifics which re- 
sulted solely from implementing AWS. 

— For the questionnaires which have been administered 
thus far, 0PM has not identified which responses are 
those of individuals not using AWS. CPM selected 
work units to participate in the study and not all 
employees within the units are necessarily using AWS. 

In summary, because, for the most part, (1) comparison 
groups were not established, (2) pre-experimental data was 
not obtained, and (3) the methods being used do not analyze 
the interrelationships of variables and their effects on AWS, 
0PM will not be able to dif f erenti::.te and assess the effects 
of AWS and the effects of variables. 
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Onsite studies 



Although 0PM states in its master plan that the onsite 
studies will supplement the longitudinal and cross-sectional 
study and the narrative reports, the 0PM Research Director 
told us at the conclusion of our review that the onsite 
studies will probably yield the most reliable data. As cur- 
rently structured, he believes the studies will allow 0PM to 
make more specific conclusions about AWS effects and to 
develop a better understanding of the effects and interrela- 
tionships of variables on a particular AWS. 

We agree that onsite studies could be useful in assess- 
ing AWS effects, especially when comparison groups are used. 
However, we believe at least three additional essential ele- 
ments must be considered. First, the 9 or 10 onsite studies 
which are presently planned include agencies and work units 
which were judgmentally selected. These sites were chosen 
primarily because of the availability of certain kinds of 
data and a willingness to cooperate — not because they are 
statistically representative of any major segment of the Fed- 
eral work force. The problem with this approach is that OFM 
is gathering and analyzing extensive amounts of data which 
may not be typical of the Federal work force. It is likely, 
therefore, that the onsite studies will result in 0PM' s pre- 
senting facts and conclusions only about the work units in- 
cluded in the studies- 
Second, while :)f the onsite studies will assess 
the effects of AWS on more than one of the six impact areas, 
we believe it is necessary to consider them all because 
there may be offsetting effects. 

Third, the onsite studies need to be more formal and 
structured. Currently, the format for each study is differ- 
ent and is tailored to each specific agency or work unit. 
This approach makes it less likely that 0PM will be able to 
validly compare the onsite results. Additionally, there is 
a need to include a structured set of questions for inter- 
viewing employees, supervisors, and managers so that 0PM is 
assured of obtaining at least 'the minimum amount of informa- 
tion it needs . 



Narrative reports 

While the use of narrative reports is noteworthy be- 
cause it represents an attempt by 0PM to obtain information 
from all experimenting work units, we believe the reports 
will generate more data than 0PM is equipped to interpret 
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and analyze. Also of concern is the fact that CPM has pro- 
vided only general information on what should be included in 
the reports and has not provided guidance on how the informa- 
tion should be obtained or developed. Additionally, 0PM has 
not developed a procedure for collating and interpreting the 
information which will be included in these reports. 0PM 
will, at the conclusion of the AWS experiment, have as many 
as 1,300 narrative reports of varying lengths and formats 
which it will not be equipped to analyze- We believe that 
the methods for analyzing and evaluating the data and vari- 
ables must be specified in advance. 

Special energy study 

As is the case with other aspects of 0PM 's evaluation, 
the specific number and types of work units and their loca- 
tions were selected judgmentally . Consequently, 0PM will 
not know whether the data obtained and the conclusions drawn 
are representative- In addition, we do not believe that the 
method of analyzing the results will meet the objective of 
assessing the effects of AWS on mass transit facilities - 

The transportation survey is geared toward gathering 
data on commuting habits of individuals working varied sched- 
ules, including the standard 8-hour day. 0PM plans to ana- 
lyze the differences in commuting habits of individuals work- 
ing different AWS and to compare the commuting patterns of 
AWS users with nonusers. While this information will be 
both useful and interesting, we believe that the approach 
must also address how AWS affects individuals' commuting 
habits and how the availability of transportation modes af- 
fects individuals ' opportunities to use AWS and the degree 
of flexibility permitted. 

We also believe that, because the transportation survey 
is being administered on a specific day, the questionnaire 
should be revised to insure that the particular commuting 
mode listed is actually the one the individual normally uses. 

CONCLUSIONS 

The Federal Employees Flexible and Compresiived Work 
Schedules Act of 1978 wisely provides for a period of exper- 
imentation and evaluation before a decision is made regard- 
ing the desirability of allowing permanent use of AWS. The 
ongoing experiment is, in our view, a large and important en- 
deavor in the Federal Government. We believe it is essential 
that the experiment's evaluation provide valid and reliable 
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conclusions on the effects of AWS in the Federal environment. 
It is also very important to determine whether, and in what 
situations, AWS is feasible. 

If the advantages which have been realized as a result 
of using AWS in the private sector also apply to the Federal 
sector, AWS may improve the efficiency of Government opera- 
tions and the quality of work and home life, increase em- 
ployee morale, and reduce operating costs. AWS may also re- 
sult in reduced energy consumption and better use of mass 
transit facilities. If these advantages are applicable to 
the Federal Government, we believe the potential exists for 
considerable cost savings. In addition, it is essential 
that the disadvantages be identified and assessed in light 
of the competing benefits so an actual evaluation of the de- 
sirability of using AWS can be accomplished. 

0PM' s current master plan for evaluating the AWS experi- 
ment will not generate the information needed to assess the 
various positive and negative effects. We believe that, at 
the conclusion of the 3-year experiment, 0PM will have a mas- 
sive amount of data, but will not be in a position to pre- 
sent valid and reliable information on the effects of AWS, 
and the experiment's intended objectives will not be 
achieved. The principal reason for this was a decision by 
0PM not to conduct a true scientific experiment, but rather 
to let agencies design their own AWS programs, to provide 
them with only broad guidance on how to evaluate those pro- 
grams, and to cut back on its ovs'n factorially complex design 
which would have allowed the assessment of a number of vari- 
ables which affect AWS results. 

As more questions and criticisms are raised concerning 
the evaluation approach and analytical methods, the evalua- 
tion results will become less credible. The result will be 
the completion of a 3-year experiment with little additional 
knowledge about AWS and whether, and in what situations, it 
can be successfully and permanently used by the Federal Gov- 
ernment. The consequence of this effort could be permanent 
adoption of AWS in environments where it is not in the best 
interest of the Government to do so. Conversely, the Congress 
could decide not to allow the permanent use of AWS when in 
fact its use might be beneficial from both a cost and effi- 
ciency standpoint. 

We believe that, given the present state of the AWS ex- 
periment and evaluation, at least four options exist: 

— Continue the current experiment and evaluation with- 
out change, accepting its weaknesses and limitations. 
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— Modify the existing experiment and evaluation to im- 
prove the quality of the evaluation results, realiz- 
ing that the data may not be representative. 

— Develop a new evaluation approach to maximize the op- 
portunity for providing the Congress with the needed 
data. 

— Completely stop the AWS experiment. 

We believe the first and last options are not desirable. 
If the existing experiment and evaluation are continued, the 
data will be questionable, the experiment's intended objec- 
tives will not be achieved, and the Congress will not have 
valid and reliable information to decide the desirability of 
permanently using AWS. Stopping the experiment is also not 
desirable because no one will know whether the benefits 
derived in the private sector also apply to the Federal Gov- 
ernment. This would be especially crucial if AWS can reduce 
operating costs and increase productivity. 

We believe that modifying the existing evaluation ap- 
proach or developing a new one are the best options. How- 
ever, the experiment may have to be extended beyond 3 years 
to allow the master plan to be redesigned and executed if 
the experiment's objectives are to be achieved. Rather than 
gathering massive amounts of information from which broad 
generalizations will undoubtedly be made, we believe 0PM 
should place greater emphasis on collecting and analyzing 
quality data from which reliable and valid conclusions can 
be drawn. In our opinion, the effects and interrelation- 
ships of variables should be analyzed and some form of ex- 
perimental approach with comparison groups should be used. 
This approach could include the development of tightly con- 
trolled demonstration projects and the random assignirent of 
units to those projects, as well as to a delayed implementa- 
tion control group. 

RECOMMENDATIONS TO THE CONGRESS 

In view of the importance of the AWS experiment and the 
fact that the Congress will eventually have to decide whether 
to allow permanent use of AWS in the Federal Government, we 
recommend that oversight hearings be held on the status and 
adequacy of AWS implementation and evaluation. In conducting 
this oversight, we recommend that the Congress consider the 

— need for, and costs and benefits associated with, 
modifying the existing master plan or developing a 
new one; 
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— necessity for extending the 3-year experiment, and 

— desirability of establishing a joint executive agency 
task force to redesign and execute the master plan 
and to provide the needed experimental control. 

RECOMMENDATIONS TO DIRECTOR , 
0PM, AND THE CONGRESS 

We do not believe that 0PM ' s master plan will provide 
the information the Congress needs to assess the effects of 
AWS and to determine whether, and in what situations, it may 
be permanently used in the Federal Government. For this 
reason, we recommend that 0PM work with the Congress to as- 
sess the current master plan and the type and quality of in- 
formation it will yield. As a minimum, we believe 0PM and 
the Congress must agree on the 

— specific evaluation objectives, 

— criteria for measuring attainment of those objectives, 

— costs and benefits of various experimental designs 
and analytical approaches, and 

— desired levels of precision and confidence. 

In making this joint assessment, we recommend that 0PM 
and the Congress consider the desirability and need for: 

— Using scientific sampling procedures which would al- 
low findings and conclusions to be projected to the 
overall Federal work force. 

— Analyzing multiple variables which may affect AWS im- 
pact and adjusting for variables which affect the 
results . 

— Gathering public views about AWS and its effects on 
the degree and quality of the Federal Government's 
service to the public. Such consideration should 
include comparing public views with those using and 
not using AWS. 

— Establishing a "true" scientific experiment in which 
program design is carefully controlled, units are 
randomly assigned to program formats and to a con- 
trol condition, and standardized data is collected 
on the effectiveness of the program. 




To the extent that features of 0PM* s current evaluation 
approach are incorporated in any new plan, we have the fol- 
lowing specific recommendations. 

Longitudinal and cross-sectional study 

— Eliminate the current employee and supervisor ques- 
tionnaire which is being administered four times 
during the experiment . 

— Design a new questionnaire which would specifically 
address the AWS experiences of employees, supervisors, 
and managers; individual reactions to AWS; and self- 
reported changes in individual behavior which resulted 
from AWS. The questionnaire could be administered 
only once, toward the end of the 3-year experiment, 
to a sample of individuals which would be representa- 
tive of the Federal work force. 

— Incorporate two open-ended questions in the question- 
naire. The first would ask respondents to describe 
the most positive specific things that happened to 
them as a result of using AWS. The second would ask 
them to describe the most negative aspects. This ap- 
proach will identify the specific things individuals 
actually experienced as opposed to strictly subjec- 
tive responses which might be affected by perceived 
notions of what the individual should have experienced. 

— Obtain responses from both users and nonusers of AWS. 
In an organization where AWS is being used, the indi- 
viduals not participating in the experiment may be 
those who are most adversely affected. 

Onsite studies 

— Include agencies or work units which are more represen- 
tative of some of the larger segments of the Federal 
work force. 

— Standardize the format for the case studies to a de- 
gree so that the results can be compared. A standard 
procedure should be developed for interviewing a spe- 
cified number of personnel within each organization, 
and a standardized document should be used for report- 
ing productivity changes. This latter document should 
provide for assessing the degree to which productivity 
measure is under employees' control. It should also 
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provide for a description of the processes or mechan- 
isms by which AWS influenced productivity. For exam- 
ple, if productivity increased, was it because the 
building was open more hours, more projects were being 
held over, or more uninterrupted time was available? 

— Consider using outside contractors to conduct some of 
the case studies to determine how AWS was implemented; 
the reactions of employees and management; and the 
changes in operations, employee routines, and unit 
output. In-house assessments and independent outside 
assessments could be compared. This approach might 
be particularly useful since 0PM has been charged with 
both implementing and evaluating the AWS experiment. 

Narrative reports 

— Require a sample of work units to prepare their narra- 
tive reports about 1 year after they begin their AWS 
experiments. This approach could serve as a pretest 
to determine the major difficulties encountered in 
evaluating AWS and to develop a more structured and 

. useful reporting format for the remainder of the units 
to use. By specifying more precisely what information 
is required and how it should be obtained, 0PM should 
be able to minimize the probability of biased and in- 
correct reporting. Such an approach would also help 
to eliminate the possibilities of OPM being inundated 
with a mass of data which varies widely in quality 
and content and for which there is no explicit analy- 
sis plan. 

— Monitor the work units' data collection. There is 
too little control to insure that the information 
which will be included in the reports is carefully 
and systematically compiled in an unbiased manner. 
OPM should provide information to individuals who are 
charged with preparing the narrative reports. 

— Determine the approach for reviewing and analyzing 
the reports as soon as possible. 

Special energy study 

— Include in the study an assessment of (1) how AWS has 
affected individuals* modes of transportation, vehicle 
usage, and ability to use public mass transit and (2) 
how the availability of mass transit affects individ- 
uals' abilities to use AWS or to exercise maximum AWS 
flexibility . 
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Additionally, we recommend that, to the degree possible, 
0PM reallocate internal funds to the AWS Program Office so ad- 
ditional experienced staff with the necessary qualifications 
can assist in redesigning and executing the master plan. 
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CHAPTER 5 
NEED FOR CONGRESSIONAL OVERSIGHT 



The Federal Employees Flexible and Compressed Work 
Schedules Act of 1978 is significant and important legisla- 
tion which we support. The results of the 3-year experiment 
which was mandated by the act, may ultimately affect the 
work habits and patterns of all Federal employees. Addition 
ally, if a decision is made to allow permanent use of all 
types of alternative work schedules in the Federal sector, 
we believe that the private sector may expand its use of 
more sophisticated work schedules. 

In our view, the importance of the 3-year experiment 
cannot be overstated. We believe it is essential that the 
overall experiment and individual agencies 'and work units* 
work schedules be carefully planned, designed, implemented, 
and evaluated. The experiment must be controlled as much 
as possible. Control is essential for determining and as- 
sessing the actual AWS effects; whether the maximum benefits 
to both the organization and employees have been achieved; 
and whether the results of an AWS experiment are caused by 
the work schedule itself or by the manner in which it was 
planned, designed, implemented, or evaluated. 

Because of the importance of this legislation and the 
potential benefits which both the Government and employees 
may derive from using AWS, the evaluation of the experiment 
must be closely controlled and monitored. In retrospect, it 
is unfortunate that the implementing legislation did not in- 
clude an oversight requirement and specify a desired over- 
sight procedure. The act simply required 0PM to establish 
an experimental program; develop and execute a master plan 
for evaluating the program; and prepare two reports at the 
conclusion of the experiment, recommending needed legisla- 
tive and administrative changes or actions and addressing 
the results of the overall experiment. 

An oversight framework should have included extensive 
discussions and communications between 0PM and the Congress 
concerning the: 

— Specific objectives and expectations of both the 
overall experiment and the evaluation. 

— Deve"' o?pment of evaluation criteria for measuring AWS 
impart and for providing the necessary information. 
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— Methods for collecting and analyzing the required 
information . 



— Procedures for preparing the final analysis and 
reports. 

For each of these steps, various alternatives should have 
been considered and all parties should have been informed of 
the potential advantages and disadvantages of each approach 
and the cost involved. We believe that before the evaluation 
began, the Congress and 0PM should have determined jointly 
what specific evaluation approach should have been used in 
light of the advantages and costs involved. Most importantly, 
the evaluation approach agreed upon should have been one 
which would provide the type of valid, reliable, and conclu- 
sive evidence the Congress needs. 

SUGGESTED OVERSIGHT PROCEDURE 

In prior testimony before the Congress, we have recog- 
nized "a growing consensus on the need to improve congres- 
sional oversight." We have stated that oversight is the 
process by which the Congress learns about the implementa- 
tion, results, effectiveness, and adequacy of the laws it 
has enacted and the programs it has authorized and funded. 

We have indicated that oversight requires the Congress 
to "acquire knowledge about the operation and results of 
laws and programs" and to "provide for the collection and 
reporting of information on programs and their results." We 
support the need for clear statements of program objectives 
to enable systematic monitoring and evaluation of programs. 

In our report, "Finding Out How Programs Are Working: 
Suggestions for Congressional Oversight" (PAD-78-3, Nov. 22, 
1977), we suggested that a disciplined process be estab- 
lished for agencies to follow in monitoring, evaluating, and 
reporting on their programs to answer congressional oversight 
questions. We further indicated the importance of the com- 
mittee and agency agreement on the oversight questions which 
are most important and on the evaluation measures which can 
satisfactorily answer those questions. 

The report presented a framework for an oversight pro- 
cedure which included 

— setting up oversight requirements, 

— reporting agency progress in implementing programs, 
and 

37 



50 



— reporting planned evaluation measures and results. 

We believe the oversight planning framework discussed in 
that report is an excellent tool for assisting the Congress 
in planning and structuring effective oversight procedures, 
and it should have been incorporated in the AWS legislation. 
While oversight was not provided for in the legislation, we 
strongly believe it is needed now and should be initiated 
through congressional hearings. 
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MODELS OF FLEXIBLE AND COMPRESSED 
WORK SCHEDULES 

FLEXIBLE SCHEDULES 

The following models, which 0PM prepared, illustrate 
examples of typical flexitime configurations being used in 
the AWS experiment. The flexitour and gliding schedules 
have been used in the Federal Government since 1972. 
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(1) Flexi tour/Modified Flexitour 

In the following example 7:00 a.m. and 5:00 p.m. represent the earliest 
time an employee may begin work and the latest time an employee may end 
vmder this program. The employee may select a starting time between 
7:00 a.m. and 9:00 a.m.> however, all employees must be present between 
9:00 a.m. and 3:00 p.m. 



Flexltour/Modified Flexitour 



ST, 



m 



f Flexible Time 



CoreTime 

(Includes Vs-hour lunch) 



I I r 



Flexible Time 



7:00 a.m. 9:00 a.m. 



3:00 p.m. 5:00 p.m. 



Flexitour 

-employee preselects starting time 

-may select new schedule at time intervals provided by program 
Modified Flexitour 

-same as above but schedule may be modified with prior notification 
and approval of supervisor 
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(2) Gliding Schedule/Modified Gliding Schedule 



Gliding/Modified Gliding 



.... 


CUSTOMER SERVICE HOURS 




/ Flexible// 
//Time/ A 


Core Time 
(Includes y2-hour lunch) 

-r 1 1 1 -I 1 


mm 

7 Flexible/7 

V/Time/// 

m//// 



I I I \ I I 1 T 1 I 

7:00 7:30 9:00 3:00 4:30 6:00 



a.m. p.m. 



Gliding Schedule 

-within flexible bands, employees may vary starting time without 
prior notification or approval of the supervisor 

Modified Gliding Schedule 

-9-hour customer service band established 

-employees may vary starting time biit must insure minimum coverage 
level is maintained during customer service hours 
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(3) Variable Day 



Variable Day 



6:00 10 2 6:00 
a.rrv p.m. 




Total Hours Worked Weekly = 40 



-employee may vary the length of the workday as long as he/she Is 
present for core time within limits established by organization 

-must work or account for the basic work requirement, e.g., 40 hours 
for a full-time employee 



-credit hour accumulation Is limited to a maximum of 10 hours 



APPENDIX I 
(4) Variable Week 



APPENDIX 



Variable Week 



WEEK 1 WEEK 2 

6 10 2 6 6 10 2 6 

a.m. p.m. a.m. p.m. 




Hours Worked 45 37 



Total Hours Worked Biweekly = 45 + 37 = 82 
Basic Work Requirement = 80 

2 credit hours remaining 

-employee may vary the length of the day and the v;orkweek as long 
as he/she is present for core time 

-must work or account for the basic work requirement, e.g., 80 hours 
each biweekly pay period for a full-time employee 

-credit hour accumulation for carryover to a succeeding pay period is 
limited to a maximum of 10 hours by the Act, or to such lesser amount 
as determined by the organization 



43 

^6 



APPENDIX I 



APPENDIX 



(5) M^^xiflex 



Maxifflex 



WEEK1 

10 2 




WEEK 2 

10 2 



Hours 



Hours Worked 43 




Total Hours Worked Biweekly ^ 82 
Basic Work Requirement =80 

2 credit hours remaining 

-employees must be present for core days as well as core hours 
-basic work requirement is 80 hours earh biweekly pay period 
-credit hour accumulation is limited to a maximum of 10 hours 
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COMPRESSED SCHEDULES 

The following models of compressed work schedules were 
also prepared by 0PM. While the 3-day workweek is illu- 
strated, its use has been limited under the experiment. The 
4-day workweek is presently the most popular compressed 
schedule . 
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(1) Three-Day Compressed Schedule 



3- Day Week 



HOURS WORKED 
13 hours, 20minutes 
13hours, 20minutes 
IShours, 20minutes 
13 hours, 20 minutes 
13hours, 20minutes 
13hours, 20minutes 



Total Hours Worked Weekly, GROUP A =40 
Total Hours Worked Weekly, GROUP B = 40 




-full-time employees work 40 hours, 3 days each week 



-basic work requirement is 13 hours, 20 minutes each day 
and 40 hours each week 
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(2) Four-Day Compressed Schedule 

4-Day Week 

Hours Worked 




Total Hours Worked Weekly = 40 

-fu]l-time employees work 40 hours, A days each week 

-basic work requirement is 10 hours each day and 40 hours 
each week 
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(3) 5-4/9 Plan 

5-4/9 Plan 



GROUP A 



WEEK1 WEEK 2 




Total Hours Worked Biweekly, Group A = 80 
Total Hours Worked Biweekly, Group B = 80 



-full-time employee works 80 hours for the biweekly pay period 
5 days one week and 4 days the next week 

-basic work requirement is 80 hours every two weeks. 
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AGENCIES AND WORK UNITS CONTACTED 

Office of Personnel Management 
Regional Offices 

Atlanta, Georgia 
Denver , Colorado 

Department of Agriculture 

Headquarters , Washington , DC 

Pood Safety and Quality Service, Eastern 

Laboratory , Athens , Georgia 
Food and Nutrition Service 

Atlanta , Georgia 

Denver, Colorado 
Soil Conservation Service 

Atlanta, Georgia 

Davis , California 

Denver, Colorado 

Department of the Air Force 

Lowry Air Force Base, Denver, Colorado 

Department of the Army 
Army Audit Agency 

Headquarters, Washington, DC 
Atlanta, Georgia 

Department of Commerce 

Headquarters , Washington , DC 
Bureau of the Census 

Atlanta , Georgia 

Lakewood , Colorado 

Department of Defense 

Defense Contract- Audit Agency, Marietta, Georgia 
OCHAMPUS , Aurora , Colorado 

Department of Energy 

Regional Office, Lakewood, Colorado 

Department of Interior 

National Park Service, Rocky Mountain Regional Office, 
Denver , Colorado 

Department of Transportation 

Coast Guard, Headquarters, Washington, DC 
Research and Special Programs Administration, 
College Park, Georgia 



49 

ERIC 



APPENDIX II 



APPENDIX 



Environmental Protection Agency 

Headquarters, Washington, DC 
Environmental Research Laboratory 

Athens , Georgia 

Gulf Breeze, Florida 

Las Vegas, Nevada 
Regional Offices 

Atlanta , Georgia 

Denver, Colorado 
National Enforcement Investigation Center, Denver, 
Colorado 

Office of the Assistant Inspector General for Audit 
Atlanta , Georgia 
Chicago, Illinois 

General Services Administration 
Regional Offices 

Atlanta, Georgia 
Denver, Colorado 

Veterans Administration 

Regional Office, Denver, Colorado 
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Thi» MCtion of the FEO€RAL REGISTER 
OOnUini rtguiitory oocum»nu having 
Cmrii tpp(«Abihrv artd lagai •ftocl rnom 
Of wtwh vi kiytd to and codM v) 
t« Cob* of Faoarai Ragutationi. to 
puMalMd und«f SO tniai pimiani lo 44 
U.8.C. 1610 

Th» Coda of Fadafii Raguiibona ia aok) 
by tha Supanoiandant o< Oooumanta 
Pncat of naw booKt a/i kaiad in tr)a 
ArtiFEDERAL REGISTER laaua of a*ch 

mootti. 



OFFICE OF PERSONNEL 
MAMAQEMENT 

iCFR Part 213 

ExMpttd S«rv)c«; Enttrt Ex^cuttv* 
CIvN 8«rv<c« 

aQIncy: Office of Peraoiuiel 
Minagement. 

action: Final ni)e. 

summary; PoBitions when fiUed for up 
2 yeara by individuals who (1) are 
placed It ■ levere diaadvanla^e in 
obtiining employment becauae of a 
sychiatric diaebility evidenced by 
ospitalization or outpatient treatment 
and have had a aignificant period of 
■ ubitantially diarupied employment 
because of the diaabihty. and (2) are 
certified to a apecific poaltion by a State 
vocational rehabilitation counaelor or a 
VA counseling psychologist are 
excepted under Schedule B becauae it ia 
impracticable to examine competitively 
for auch poaitions. 
■FFlcnvi DATt: February 27. 1900. 
FOR FURTHER IMFORMATYOM COMTACT 
On position authonty Wilkam Boyiog. 
Office of Ptrtonne! Mana8«Dant. 202^-032- 
6000. 

On position content: Hedwi^ Oswald. Office 

orPartonnai Managemrnt. 20^12 W7. 
OfTice of Personnel Maaa|cmant 
Bavarly Kt Joaat . 

Issuance System Manager. 

PART 213— EXCEPTED SERVICE 

Accordingly. 5 CFK 213.3202(k) la 
added aa aet out below: 

I213J203 Entira aatcutlva dvl aervtoe. 
• • • • • 

(V) Poaitiona at gradea GS-16 and 
btiow when filled by Individuala who: 
(1) sre plsced si severe dissdvaotage in 
obtsLning employment becauat of a 
ptychiatiic diaability avidtnoad by 



boapitalization or outpatient treatment 
and have had a aignificant period of 
aubatantially diarupied employment 
becauae of the diaability: and (2) are 
certified to a apecific poaltion by a State 
vocational rehabihtation counaelor or a 
Veteraru Adminlatration counaeling 
• paychologiat who Indicatea that they 
meet the aevere diaadvantage criteria 
atated above, that they are capable of 
fixDctioning In the poaitiona to which 
they will be appointed, and that any 
reaidcal diaability la not job-related. 
Employment of any individual under thla 
authority may not exceed 2 years. 

(5 us e 3301, 33QL EC 10677. 9 CFR 1054- 

1956 CoDp. p. 216) 

rn De^ v^joi ruad s-iKB aa w) 

aa^NQ oooa fm ti a 



5 CFR Part 620 

Artematlw Work ^fmAnXm^ 
From g CFR 

AOCNCv: Office of Peraonnel 
Management. 

ACTiOSt: Final Meater Plan for the 
AJtemaUve Work Schedules 
Experimental Program (AWS). 

summary; The Federal Employeea 
Flexible and Comprvaaed Work 
Schedulea Act of 1970 requires the 
Office of Personnel Management (OPM) 
to eatabliab a Maater Plan containing 
the guidellnea and criteria by which 
alternative work achedule experimenta 
In the Federal Government wUl be 
evaluated. Thia document revokea the 
Maater Plan from the OPM regulationa. 
and adopta a new final Maater Plan to 
be incorporated into the Federal 
Personnel Manual. 
tmCTTVl OATI: April 14. 1960. 
FOM FUimCII INFORMATION CONTACT: 

Dr. Raymond |. Kirk, Office of Peraonnel 
Management. Office of Program 
Planning and Development. 19C0 E 
Street. NW.— Room 3353. Waahington« 
D.C 20416. (202) A32-MOI. 
SUPMMCIfrAIIY Mf OHMATIOiC The 

Mnater Plan waa publiahed on July 20. 
1079. (44 PR 42601). on an interim baaia 
with commeota Invited for final 
rulemaking. Baction 620.107 of OPM* a 
regulatiooa (6 QPR 620.107) waa 
rcaervad for the Maater Plan. That 
reaarvad aaction la being revoked and 
the Maatar Plan wiU appear aa 



Appendix A. Book 620. Federal 
Peraonnel Manua* Supplement 990-2. 
For the information of the uaer. analysis 
of comments on the interim Maater Plan 
and tha reviaad Maatar Plan are printed 
below. 

Three commenta ware received. One 
offered an organliation*a continued 
aupport for the experimental program. 
The other two euf^atad that the 
magnitude of tha propoaad data 
collection would create aignificant 
adffllniatrativa problema.The large 
number of organlxationa that have 
Indicated that they plan to experiment 
baa resulted in a reduction in the 
magnitude of data collection. 

Toe reviaioo of the Maater Plan 
focuaea on the typaa of data to be 
collected and the extent of the data 
collection. The major changea axe: to 
reduce the aample alze of the 
longitudinal atudy, to replace the apadal 
Intenaive atudiea (except the energy' 
study which will be retained) with a 
email number of on-alte atudies: and to 
require all experimenting prganizationa 
not lelected for the longitudinal, on-atte. 
or energy atudiea to aubmit a narrative 
evaluation report on their expeiiment 
near the concluaion of the experimental 
period. 

Section Analyaia 

Section 1. Background— No changea. 

Section D. Reaeorch Queations— The 
acope of oueationa A4. E6. and F5 waa 
reduced aue to the rcviaed design 
matrix. 

Section lU. Conduct of the Evsluatlon 
m-A. Deeign— Section replaced to 
reflect the new daalgn outlined 
above. 

ID-B. Sample— The diacuaaion of the 
oiiginal deoign matrix ia eliminated. 
Diacuasion of the new deaign matrix 
for the longitudinal atudy ia in ni>E^ 

ID-C Experimental Control— 
Reference to control aroupa in the 
Intenaive apecftl Btudtea haa been 
eliminated since those studies hsve 
been eliminated. 

ID-D. Implementation— Reference to 
local project and research 
coordinator training haa been 
deleted aince it will not be 
conducted. The "Implemcntetion 
Guide** and '*Supervisora Guide" 
referred to have been conaolidated 
and are rafetred to in the aection 
*Uucationa] Materiala". 

in-E Data Collection— The heading 
baa been changed to "Dats 
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CoUectioD tnd ReporHzis*' to rrflrcl 
Ihe chtnge In approach. Th« aactioo 
baa been reviMd to Include 
tnforxDalion on tba oarrative 
evaluation report!, the reduced 
deaign matrix for the longitudinal 
atudy. Q»«i(e atudjaa. and the 
aimjp IW a«ctioo on 
InitAtiva Speaal Studies" bas 
bMo tbmiaated. 

ID-F. AxkAlytic Methodology-- 
References to the analysis of (he 
aarrativt reports tod ao-«i(e studies 
bava been added Anaiyais of 
variance baa repUced regreiaiOD 
analyals aa the Ibird of 
stabaticA) procedure. Analyiis of 
vaiiaoce ia a nore approfiriaie 
statiatical prooediue to uae with the 
reduced longitudiiial study. 
References to special studies bave 
been etimineted 

ID-G. Reportj — No changes bave been 
made. 

Mastar Pba far Iba Allvreoliva Wori 
ScbedvlM (AWS) LxpOTimMUj rn^mm: 
Tabu ef Caolvls 

L lackfrouod 

A. Cenaral InfonastiOD 

B. Pub. L 

n. RnMitA QuMboos 

A. Cfftdency of Covamnent Openoonj 
a MtM TraDiit FftdUOai and TVaffir. 

C. Ltvf U vi £aergy CoDfumptioD 
D S«rviot to Iba Public 

E. OpportuQidci for FuU-tuae and Pfirt-tune 
Employment 

F. Quality of Life for Indjviduali and Ftmlliei 

nt Coodud of Um EvaluatioD 

A. Dengn 

B. SanpU 

C bqwruncDtal Cootrol 

D. IffiplcmeutatioD 

E Data CoUectioo snd Reporting 
F. Aaalytic Matbodology 

C. Raporla 

Master Ptan for the AJlereatlvs Work 
Scbedulea Experimente] Progrmra 

The Federal Employees Flexible and 
Compressed Work Schedules Act of 
1078 requires the Office of Personnel 
Management to estabUsb s program to 
provide an adequate basis on which to 
evaluate the effectiveness of attemabve 
work schedules. Tds Master PUn 
outlines the research queaUoni. the 
experimcBte] design, the data collection 
procedurea, and the analytic teckniques 
which ttfU) be used for evaluating the 
Unpact of alternative work acbedulea on 
the Pederai woffk force. 

L BedtgywMl 

A C^Mtal InfoTmaUoD 

llie S-day. 4D-faoiir mai Tee k wflh 
fixed atartkng and eadlng timee bas 
remained tfae domiaani work schedule 



for the past 40 yean. It ii only In the 
past 12 years that organiutioni have 
begun to experiment %v)th alternative 
work schedules, that if. work schedules 
which allow some flexibility In selection 
of starting times or which comprei i (he 
workweek Into some period shorter than 
the treditionat ( days. 

Tbs two general categories of 
altemative work schedules ar« Oexible 
and sompreaaed workweeks. A flexible 
schedule allowa an empioyee to vary, 
within conatraintj set by the 
org antra tion. the times be or she reports 
for daty and departs from work, A 
corapreaaed workweek is one which 
compreaaes the 40-bour workweek inlo 
less than 6 daya. or alteraativciy the 60- 
bour biweekly pay period into leu than 
10 working days. The most common 
compreaaed woricweek baa four. 10-bour 
days. 

In 1967. Meisenchmltl-Boelkow- 
Blohro. an aerospace company in 
Munich. West Germany, became the 
nrst malor Industrial plant In the world 
to adopt a flexible working hours 
arrangement for its 2.000 employees. The 
Impetus behind this Tirst experiment 
«vith flexitime was the severe tralTic 
bottleneck around the factory, caused 
by several thousand woricers all starting 
and leaving work at the same time. 

Within IS months the experiment was 
judged a success, and flexitime was 
made permanent At first slowly, and 
then later al an increaaing pace, other 
European business firms began trying a 
variety of scheduling arrangements 
involving flexible hours. 

Although first introduced la the 
United SUIcs in IffH. by 1077 there 
were an estimated 2.5 to 3^ miilioo 
employeea (approximalely 6 percent of 
the working population) on flexible 
scbedulea, not counting tboss 
professionals, managers, aalespeople. 
and setf-eoiployed workers who bad 
long set their own work schedules. 
Additionally, there were 2.1 Bullion 
American workers on compreaaed 
workweeks in 1077. 

In a recent review of the empirical 
literature on flexible hours. 
Golemblewskl and Proehl (Robert 1. 
Colembiewskl and Cari W. Proehl. )r.. 
"A Survey of tfae Empirical Literature on 
Flexible Workhours: Character and 
Consequences of a Major bioovation." 
Academy of Management Her jew, 
October 107V, pp, 07-063) found that 
there is «irldespread Interest la and 
entbusiaem for these schedules eren 
though an empirical baala for adopting 
Iheni la. for tfae moet p«t Isckteg, 
Hitherto, tmn bas »ot bean aufndent 
study, ftlbar in Bumbeia or tn rigor, to 
attrfbnia epedllc differences io revolts 
to various ways of etMduiliig or 



■dminif tering such schedules. Few 
studies used control or companson 
groups; few provided a longtudina! 
perspective or any sort of statistical 
treatment Another deficiency of 
previous atudies Is Ihsl most of these 
studies Mm ponducted in dericsl. 
whita<«oUar «po(exu Furlherroore. 
liiese studies tended to overlook the 
Impact of alternative work schedules on 
performance and productivity. Finslly. 
peat studies have not been sophisticated 
enough to take into account the 
variability that may result from the 
differences between union and non- 
union settings. 

In summary, previous studies on 
alternative work schedules have been 
narrow and limited. In addition to the 
deficienciea discussed above, they have 
tended to focua largely on employees' 
attitudea about such schedules and on 
macro-behavioral variables, such as 
effects on the use of vacation lime and 
on tardiness. Conversely, they have paid 
Uttle attention to managers* attitudes 
and changes In these attitudes as 
affected by such schedules. 

B. Pub. L gS^90 

The President and the Congress have 
found the evidence on alterrtstive work 
schedules to be aofficienlly encouraging 
to warrant the ertactment of the Federal 
Employees Flexible and Compreaaed 
Work Schedules Act of 107& Pub. L OS- 
300 mandates a 3»year period of 
controlled experimentation with the use 
of flexible and oompressed work 
schedules for employees of agencies In 
the executive branch of the United 
States Government. The purpose of the 
experimentation la to determine the 
lmpacta-"botfa poeltivs and negative— 
which theac allonatives to traditional 
work schedules may bave on: (i) 
Efficiency of Government operations: (2) 
aervice to tbs public; (3) mau transit 
faciiitiea; (4) energy consumption: (5) 
increased job opportunltiss; and (0) the 
quality of life for individuals and 
familiea. 

The experimentation is made possible 
by the temporary modification of certain 
premium pay and scheduling provisions 
of: (1) Title 5. Ut^ited States Code, and 
(2) the overtime psy provisions of the 
Fair Labor Standards Act (FLSA). These 
modifications are appUcablr only to 
those agencies or work units 
participating in a teat program; ail 
permanent provisions of Title 5 and the 
PL3A remain in effect for 
nonpartidpatlng agency activities and 
emplofMa. 

Pab. L 15-m hvtber requires thai the 
0PM develop er»d conduct an 
experimental program of sufficient depth 
and diversity to: 
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* * *pwv«tfatB«d«qu«ltb««i«OBwUob 
to mhiaft rib rffwTiii— n «Bd dOTtrataiUty 
of ptfiMfiUjr 0«iJbl« or 

MKudvt bfMck tSMlioa 4Mti at Nl^ U 



- Jn presc 

quMtioDt wUch the profram wlU 
adc hm la ofdvr to cany out the 
raqidiad wahttitin of the lapact of 
alttraativt work tcbedulet on the 
Pedara] work force. 

WhUt ftw previouf itudiei btve 
■yiUmatkaDy txamlnad Ibt tffacta of 
aJtereatNa work acbedulet. there beve 
beta • ealBciaBt numbar of itudlea, and 
Iba pattern of reMilt« bai baao 
eootlatcDt aootiib lo saneit • eet of 
variablat for the pmaat retaarcb 
pro|acL 

Caoaral «yttami theory provides • 
beuriitic moM for axaniiiloi the 
IntenalatkmthlM aaoni the varieblei. 
•Variable! ouy be datelfled Into one of 
three types: Input, process, and output 
A model for the present project to eho%vn 
In Plfurt 1. Input varisbles are those 
factors which are outside the dkect 
control of the work unit. U« they are 
Inputs to the work oinJt In the present 
project, such variables as mission, 
location and work schedule are 
examples of inouta. Process variables 
are those variables which are Interna] to 
the woric unit and affsd the functionlnf 
of the work unit. Le^ the orfanlxatioaal 
climate, the implemcntalioo of the 
altemstive work schedule, and the 
supervisor's behavior; The outputs are 
ths end prodacti. the results of the work 
unit's activitlas. In the model pcaeenied 
In Flfure t the six impact areas 
^edfied in L are 
cooceptualiaod as the ootputs. 

input 

Altomstivt Wsfk SAmi^ 
PWxtiae 

ConpteMed workweek 
Onsaisstfoiisl GherscMslkB 
Ceopepklctoratlea 
SUeoTweikMlt 

PUactioa aatf tschaoloo or w«k ^ 
I er ebMBos erbarfilBiBt Mil 




EoHgy CoaswBptloe 
Servioi Id Public 
teployoMttl Oppemiailtos 
QutUtyorUfs 

The yeaeral eystasss model snntsts 
thst there to ao simple single answer to 
the question. *'Whef to the effect of 
ellemetive work schedule JTT The 
vailebles are all highly InlersctJve. end 
the effeeto of a given ecbadale will be 
influenced, or modereled. by the spedflc 
inputo and proo es e as opciatlaf In the 
syirtem. Porthto reason, e aaries of 
reeearchqoeetkms has been fomalated 
for the preeent walaatioo oTaharaaHve 
work scbedulee In Federal ageociea.TKe 
epedBc reeearch qaeedoos tstaoded to 
eddrees the six Impact areas ore hsled 
below. 

A. Efficiency ofCoremamni Opmutioaa 

1. What changes occur in mission 
eccompUshment and work unit coeto? 

2. How are management tasks 
affKtedr What problems develop and 
how are they eotvedt 

3. Whet are the effects on 
crganlzational dtaaate reenlting Fom 
AWS7 

4. Are effideocy and prodactlvity 
affected by the type oT A WS vaed? 

B. Ma$$ TYaau'i P^cUitim and TYaffic 
1 Is there e trmnaportatioo edvantage 

from AWS for either Individuals or 
public transit sathorttieBr 

2. What affccto do AWS have on the 
choice of commuters* tiansportation and 
on commuting timeT 

3. What are the affacto on car poob 
and van pool programsT 

4. What to the aSoct on nmh hour 
oongesttonT 

5. U there e dhanfi In lacnattoaal 
travel? 

CUvlgefEomgyCofmm^titm 

1. Do eneigy aavlnfs reanit from the 
effeeto of AWS on transportatiOD7 

2. U there an incraaaa tai anaigy 
OQCisamption from balldlnt aid 
aqnlpnuBit nee aa e raaah or AWSr 

t. What to flm net aoev tepaci oT 
AWS from transportation aodballdiif 
oonsumptfon affeotoT 

ilSerric§iQih€Miic 

1. to servloe lo the pabttc laoanaed or 
drcreasad In qoelHy or qnaatltyT 

2. To what axtaBt to the cW^ la 
service aSsoiBd by *e AWa work 
unlt*B hmdta. alae or laonttonf 

£ Ctfpnittuitim fot/kB-tiam aadPhri'^ 
HamMi^phymmi 

1. What ait the labar aivply I 

AWSf 

XWnthmn ha nam labor tea 



1 Is there e shift from perl-time to 
fuU<time employasentr 

4. Does moonlighting incjeese? 

, * ^lo^ •« best suited 

for AWff 

e. How do AWS affect the 

employment opportunitieB for woneo 

and for the handicapped? 

f, QuaLty of Lift for Individuals and 
FamilieB 

1. How to the qoality of work life 
affectadT 

2. How to the quellty of personal and 
Ma^orkhlealbcledr 

5. Do eodaL adooationaL or dvic 
activltieB changeT 

4. Do family reUttonshlps and chUd 
cars change? 

5. Do the effeeto on quality of life vaty 
with the AWS used? 

DL Conduct of fhe KvahuHoo 

AOse^ 

Ibe effeeto of the alternative work 
schedules on the impact arcoB wU) be 
evaluated by four types of studies. 
These arr (1] NanaUve avalustion 
reporto from eech experimenting 
organizations: (2) a lon^tudlnal end 
ooss-eectjcnal study of a sample of 
experimenting woA units: (3) on-site 
studies of experimenting organizations: 
and («] s apedal eludy on the net eneisy 
Impect of alternative work scheduIcB. 

The narrativs avahiation reporto from 
eech experimenting otaanliation will 
provide an overvtow of the effeeto of 
AWS Experimenting organizations will 
be required to provide basic Infonnation 
about their AWS axparimant and report 
to 0PM at the and of the axperlmental 
pacM providing their avaluaUon in the 
tlx Impact aiaaa. IWee reporto will not 
be raqnbad for offanizattoQS selected lo 
parddpatri In the koi^ludinal ooss- 
sectionaL oo^ta or anaiiy (see E2. E3, 
andEIJatBdtoa. 

The loQgltudiaal ooss-eactional study 
will oollad boi^ ob}activs dsto on the 
tunctioDing of the work nnit and 
aobjectlve attftades of smployees on 
their reactions lo the AWS. ItwlUbe 
longitudinal la thet date will be 
noUected et epacdiled ttmee in the same 
work nnito IhroaghonI the duretioo of 
eech es^erimnaL Data vrfll be cross* 
•acttond Id that II wlU onoompasa a 
variety of AWS oparatlag In e divaiaa 
sampUnsorradamladlvlttas. 

Tha loqgltndlnal ooss-sactional etady 
w« eollecl fcofermatlQa In four general 
araaae (1) AMcy characlortsllQi (21 
diary of m|« a^uteatlonal evanto (9) 
addMleoal aurvofs oftaplortas la 
axpariawntal wotk aalto and («) 
oblecttva aicUval data. Ite effeeto upon 
the varioas laspaet araai. aa detarmlDad 
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by tlot^ ticil analysis of (ba data. wlU 
be con-listed with the. various 
■liemitive work scbedultt used 6oips 
effects ffiiy be detsctsble .loon aftar the 
onset of the experiment (e.g., job 
■■tisfsction* commuting tune, lesve 
ussge); others may lake longer to appear 
(e.g.. turnover, changes in family roles). 
Some efTecu may Initially appear and 
thsn fade away (e.g . increased morale 
and supervision problems). The 
longitudinal nature of the study will 
permit the tracking of these various 
possibilities. 

The cn-iite studies will focus upon the 
aix impftct arcis listed under "Output'* 
in Figure 1. They will attempt to 
determine. a detailed way» the ettecta 
of aherDStive work schedules upon 
organizations which arc considered 
representative of certain types of 
Federal work environments. In addition 
to gathering informs tion on the six 
impact areas, these on*site studies will 
gather information that is pertinent to 
the successful introduction and 
administration of an AWS program such 
as the degree of employee involvement 
and necessary changes in time and 
attendance recordkeeping required for a 
work schedule change. 

These studies will be tailored to fit the 
structure and function of, the particular 
organize tionk selected and to provide 
data necessary to answer particular 
research questions. 

The special ptudy on the net energy 
impact of AWS will provide data both 
on the effects on transportation and on 
building operating coata. 

The four types of studies will provide 
a comprehensive evaluation of the AWS 
program. Tba narrative reports will 
provide a coBprehenslve overview* Hie 
longitudinal cross-acctional study will 
allow a syattmatic analytia of AWS. 
The on-site studies will anridb the 
conclusions of the analytic and 
narrative atudies and provide dataD on 
the ma|or (ssuet in Implementing an 
AWS. Finally, the energy study will 
provide data in an area of inaeaslng 
importsnce. While AWS appear to hold 
much promise for energy cooaenratkio. 
little ia currently known about the 
spedflc net Impact oa enaiiy 
consumption aa a result of tfaeir 
appUcatiOD lo the wociplaoe. 

Spedflc detaib on the fom typee of 
studies m provided in the Data 
CoUectloQ and Analytic Methodokv 
ttttinni 

The On4 wfll provide daU ooQactlflB 
Instrumenls, asalacanoa to organltatkaa 
Implanmtbit riltamalhra wvdL 
achedulea. and psfonn data analjiU. 
Each parUdpattag onanltatinn wlB bt 
raeponslbia for both <be day tod a f 
manafenant of the avpariManlal 



program and the collection of required 
data. Organizations should expect to 
designate one or more indlvidaals to: (1) 
Serve as the principal point of contact 
between the organization and OPM; (2) 
carry out the coordination, planning, 
and implementation of the 
organization's alternative work 
schedules experiment; and (3) in work 
units selected for the longitudinal study, 
distribute OPM data collection forms 
fiod Instruments. aMurfi adequate 
colleetfon of haselina and foUowup data 
froB the ofianizatioo's records and from 
employee aurveya, and forward the raw 
daU to OFlbTs reeearcfa ataff for 
analysia. Ordtnarlly. one pereon would 
have responsibility for all three tasks 
and functions, but in larger 
organizations these functions might be 
accomplished by two or more people. 

B. Sample 

Any agency that wiahea to test an 
altemativa work achedule may do so. as 
long as It sbides by ths cisgulations 
prescribed by OPM to guide the 
experimental prt)graffi. Thus, ths aample 
%irill essentially be self*S3lected. 
Howevert s saffident cumber of diverse 
organizations must pariff dpate in the 
alternative work schedules experimental 
program for the report to have any 
validity. For this ressoa Public Lew OS- 
390 gives OFM authority to require 
selected agendes to experiment wdth 
certain work schedules. However, it Is 
not antidpated that this provis-on will 
need to be invoked. 

C Experimental Control 

Due to the diversity and complexity of 
organizations that will be part of the 
research project It Is not possible to 
conduct a perfectly controlled 
experiment However, several 
procedum evlB be need to inaeaae 
confideDoa la infarenoaa made from the 
daU. 

Control win be provided by daU from 
two of the evaluation studies of the Civil 
Service Reform Ad baiqg nnnriucftari by 
theOPkLnafiralortheaekaatiidy of 
prodactivtty la the Federal aector. Tne 
productivity data wlO be ooUected oa an 
aggregsted basis scross onanlzattoos. 
While th-ie daU wlO not allow spedflc 
oompariaoai with the cxparimeaul 
organizatlana, Ibty will provide a tread 
line afalafi which rhafigea la 
produQtiv% fci Ifat es^MfftBaatal 
organlzatiaoe oaa be oootiparad. la 
additfoa. an attitude eurvey of 8X000 
Federal amployaes «iD be ooodoctad 
annually duttag the tfaae parted of the 
Alteraallve fl^aMaa 
Pjcperinaatal Propam^llds earfvy 
ooouloa oiiBntealioaal cflmati iOalaa in 
oofflffloa with the employee l ur we y 



which will bft used in the Alternative 
Work Schadules Experimental Program. 
As %vith the oroductivity dsta. these 
common scales will provide a trend line 
of Fedaral employees' sttitudes toward 
the work place for comparison with the 
sttitirdas of employees participating in 
the axptfiaunt Iht nature of the 
longitudinal design makes posiible 
additional control; each work unit will 
serve as Its own control to delennine 
changes over time. 

D. Implementotion 

1. Techweol Astistonce^B] 
Orientotion $ts$ions. The AWS program 
staff will conduct a series of orientsUon 
meetinga. Tlie purposes of these 
meetings will be to confer with agency 
headquarters offldals. as well as others* 
on plans to implement Pub. L Q5-300: to 
brief local agency and union 
representstives on opportunities ' 
provided by the legislstion and 
requirements forpartidpation in the 
experimental program: and to hold 
planning sessions with representatives 
of sgendes and unions thst express an 
early Intenst in an AWS experiment. 

(b) Consulting aerv/ces. The AWS 
research and implementation staff will 
be available throughout the life of the 
program to provide telephone consulting 
services and some on-site consultation. 
If necessary. OPM regional program 
staff %vlll alao be available to provide 
advice and consulting services. 

(c) Public informotion eervices. 
Central ofQce staff will be available to 
apeak before natioiMl professional 
gatherings, union meetings, conferences, 
or similar froups which desire 
information about the experimental 
program, lliey will also contribute to 
Government or other publications and 
respond to inquiries frinn the press, 
researchers, and others interested in the 
program. 

2. EducaUonol Material*. A number of 
educational materials are available from 
the OPM. 

These indude: 

(a) A booklet that briefly descTibes 
the Alternative Work Schedules 
ProgranL It covers the legislative 
mandate, tha research plan, and the 
steps to be taken to implement the non- 
research aspects of this mandate. 

(b) A slide presentation that explains 
the requtramants of Pub. L 05^390. ths 
varione fonaa of flexible aad 
oompreeaed work achedolee that nay b« 
tested mdm the law aad outlines 
experiatfatal ageadet* dsta ooUectloo 
respooiftAttae. 

(c) Aa tnplementatfoa guide that 
describes a process agendes msy follow 
la planning and ta^iiteflMntlng an 
altaiaativa work scfraduJa. Iliis golds 
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emphiiixci (oint liboManugemeat 
pUnnlnc for the experiment and 
employee participatiofi in aoalyzioi 
work requlrtmeau In their own unita lo 
thtt thty may have input into the 
proceaa by which lyitemi. deiifoed to 
■laurt tha adaquecy of the work force 
at any gtvtn lima, are formulitid. 

S. /UguhtSona and Cvniaitce. 
RefMlaboaa for thi Aitemitive Work 
Schaduiaa Experimental Program are in 
Pan 020 of the OPM'i ragvlations (title 5. 
Oada orFademl Rcfulatmu). Theie 
regulatiooa muat be oaed in oonjujiction 
with Pub. U »-<Ma The refula'oooa and 
additional gaidanoa for the 
edBinlitntian of alternative worii 
•chedule axpcrimeotal programs are 
provided in Book 020 of Federal 
Pertoonel Klaniial Supplement 99&-2. 

£ Data CoUtcUon and Reporiing. 

1. Narrotiw9 BtuJuotioa H&porU. 
Organixationa not ealactBd to paitidpata 
in the loagitudiDal croai-aacttooaL on- 
lite* or eoflfgy itvdiaa mait oonduci an 
evaluation of their axpcrimenta end 
report the result directly to OPKf afier Id 
months of axparimcntation. or by Msy 1. 
1961. whichever dste oocBrt fint The 
nam live evaluatioo repoH must include 
Infbrmatioo on the six impact areas 
Identified In Pah. L BS-WL An ouUme of 
the areas to be addressed in this report 
and the types of Information to be 
covered in the report is furnished below. 
Thii outline will be followed in 
preparing the report to provide 
maximum oompatibillty between reports 
from differest organlxatlons. The report 
will be a nootechninal summary 
aisessment of the experiment. The 
•ommary assessment ahonld techide the 
reiulti of any Interna] evahiatloo eCForla. 
Both management and local labor 
anions Involvad In tbt txpcriment 
ahottid provide Input to the development 
and prmaratlon oif the report. More 
detailed guidance will be provided on 
the prepsratloo of the nairattve reports 
thrcmgh the Isauanoe of a Federal 
Psrsoimel Manual buDetln. 

a. OiganUaUonaJ charocteriMtics. Tht 
number of amplojeea In the experiment; 
the pra-experlmental anc!* altennsUve 
woct achadnlts; bargaining unit status; 
carpooL Tan pool and paiilng fedlitles: 
availability m pqblic transportation; 
deacriptkm of tha ma)or acdviUea or 
aeivioaa of the txperimentlng unlu (a^.. 
dtricaL produca goods, public service 
contact admlnlatrative office, or sUff 
function). 

b. Effidanqr of Govenunent 
oparatioRB. Condusions about rfungea 
In productivity, sick laave, anmul laava 
and laave without pay naage. 
oondualooa aboot chaogaa la ampin ii 



turnover, number of overtime hours, ^b 
sstisfsction, and morale. 

c Mass tnntit fociliUei, and traffic. 
Any conclusions on chaoges in 
commuting hsbits such as use of msss 
transit, carpools. and private 
automobiles. 

d. Levelt ofmnergy consumptJon. 
Where svailable« note changes in the 
amouQl of energy used in the building as 
a hinctioo of changed opersting hours 
that msy result from changes in work 
schedules. 

a. ServiC0 to thepubfia Evaluation of 
the level and amount of service to the 
public if the experimenting organlzatioo 
provides direct public aervicc. 

f. Increased opportunitie$ for futt-iimt 
ond part'lime unphymenL Discerned 
chacges in the number of spplicants for 
Jobs, and levels of part-time employees. 

g. Individuals and familitM generally. 
Received effects of AWS oo family 
scheduling of child care and household 
activities and employee mrastional 
activities. 

b. Special prohhmM. Special problems 
which developed during the experiment 
such as « large number of requests for 
exclusions due to hardship dilBculties 
administering pty and leave, overtime 
or manpower problems during paak 
work load periods, etc 

2. Longitudinal Cro$M'S0ctionaI Study. 
A sample of 00 work units wUI be 
selected by OFM to be part of the 
longitudinal cross-sectional study. 
Organizations which have work units 
selected for this study wrUl not be 
required to submit the narrative 
cvalustion report 

The selected work units must have a 
ressonably homogeneous wodc 
technology and a alngla locus of 
function and activity. IMcally. auch a 
work unit will ba baadao hf a 
supervisor authorized to cniHf Uma and 
attendance carda. For fxampla. a work 
unit for pufpoaat df this nroiact ml^t ba 
a mail room, a piintiQg plant a data 
processing oenlar. a aalms ^tMip. or a 
policy group; however. aS amployaas In 
a work unit must ba oo tha same type of 
achedule. nviih tha exception of Ihoaa 
employeea excluded bacaoaa of 
personal hardship. 

The experimaatal daeign for tha 
longitudinal cnaa-aactiooal study ii a 
aimpls one-way eUaaificatloa with four 
types of achadulaa. 

The four types of schedules are S^/O . 
and 4-<lay weak compnrssed *^>**^"Tt*. 
flexible schedulea that aUow vaiiabiUty 
In the numbers of hours workad per dsiy« 
and flexible arhadiilae whicb raqalre 
amptoyaaa to mask $ hours par d^y (La« 
flexitime as aOowwl uadar pamaarat 
provlskma of tlUa S}. Within each of tha 
lour types. IS work laMa wlU ba 



selectsd representing a variety of sizes, 
locations, and functions. However, for 
purposes of analysis, these variablei 
will not be included since ihere will be 
too few case* to crests a complete 
factorial daaign. 

DaU trill he ooUaclad by each 
organitation. usIm tha iom$ and 
surveys provided by 0PM. 0PM will 
alto provide guidance and advice on 
estat>lishing osta collection procedures. 
The rsw unanalyzed date tvill be 
forwarded to 0PM for all dats reduction 
and analyaia. All data collected wIU be 
treated in a oooTidential manner no 
individuals will be identified. The 
results of the experiment will be 
reported as scores aggregsted across 
work units and orgsnizations. 
Organizations which terminste the 
experimaot prior to the end of the 
experimental period wiU provide OPM 
with dats oo the reasons for terminstion 
as well as other data which may t>e 
required. 

The following types of data will be 
collected from work units selected for 
the longitudinal cross'sectional study. 

(a) Organizational/Work Unit 
CboracteriMtia. Descriptive Informs (ion 
to be collected prior to the onset of sn 
experiment will Include: 

— Number of employees In 
experimental work unit by age. sex. 
grade 

— 4jocaUon of work unit 
P reexperimental work achedule and 
alternative work achedule planned 

*Maior activities or servloes of 
experimental work units (aj.. clerical 
produca goods, custooar contact ofTice 
or plant fiiactioo) 

—Work tachnology (a.g« machine- 
paoad va. wocker^pacad jobs. 
aulflnoDiotta va. Interdependent job. 
nature of aupervlaloo and 
communication) 

— Bwgelah^ onlt atatns 

— pool pfogrami. van pool 
proipama. paiking fadlitica. availability 
ofpid>Uc traaapaftatioo to organization 

(d) Lonp^KunoI Archiral Data. 
Oiganlaatioiia ahould obtain as much of 
the loQgitudlnal data aa poaalble 
retrospcctivaly ham existing records for 
the 12-aBonth period prooedlog the start 
of the axparimant Data collection 
prooadurea ahould ba established to 
record requtrad lafomatioo during the 
lO-Bonlh axperiauatal period which ia 
not roattealy malnlaload. Data collected 
wlUhichidalhafoUofwInr 

— lYoducUvity maeauras. If any. 
curranlly atiUaad by tha oiganizatioQ 

— INuiMwar 

--^ck leava. annual laava. and ia«7fs 
without pay aaaga (total number of 
hours par Bwoth and aumber of 
Inddanta of laava uaa per Booth) 
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^Number of luthorized overtune 

bOUTfl 

—Pin- time /full- time employee ritio 
—Accident ritei 

[c] Employee Survey. Some itUtudinBl 
ditfl ind informitlon can be collected 
only from aurveya of employees in the 
•xperlmentsl work unitf (e g., 
commutlni bsbitf ). Four turveyt of 
employees will be conducted. These 
surveys will take spproximstely 45 
minutes to complete snd will be 
collected st the stsrt of the experimental 
period, and 9 months. 12 months, and IB 
months into the experimental period. 
Tlie surveys will collect dsts on the 
following aress; 

— Organizationsl climste and quslity 
of working life 
— Commutiitf babits 
— Impsct on family and personal life 
— lob performance 
— Job aatisfactlon 
—Time utilizstion 
— AWS utilization 
—Perceived s buses of system 
— Supervisor's functions 
— Scheduling 

— RecrestioDa] travel bsblts 

(d) Diary of Significant Events, The 
local Pro|fCt Director will be required to 
keep a diary of significant svents within 
the orgsnization which might bsve sn 
Impact on the effect! of AWS. Examples 
of such events might include s move to a 
new building, a flu epidemic, s change in 
supervisors (including top level 
msnsgement). changes in work flow. 
ms|or snow storms* reorganization, or a 
critical energy shortage. 

3. Oft'Sitt Studiee, Because cert sin, 
limited types of dsta msy be difficult to 
obtain OD an overall, croas-aectional 
basis* and because aoms results msy be 
manifest only in the presence of special 
fsctorsi acme sffecis of the use of 
alternative work schedules can be 
detennined only through on-site studies. 
The 6n-slte studies will serve to 
supplsment the narrativs reports and the 
longitudinal ooss^sectloDal study and 
provide additional explsnatory detail in 
the final report They will have more 
intensive data coUectioo, and/or they 
will utilize controlled experiments 1 or 
quasl-exparimental designs. 0PM mrill 
select axperimeoting organlzatioas 
for oo*«ita atudies. These organizations 
will Dot bt raquirad to submit the 
DazTttiva evaluation report The oo>stte 
atvdias will be ooodvcted hf the AWS 
reaeafcb itaff and wfl bi tailored to Iba 
■pedfled offtfllufleo to pivfldf 
infonnatloQ on the six fanpad areas of 
. Pub. L 05-390 as wall as to Identify the 
pr^lsms and beoaOts tn tolwed in 
planning. faBplamcntiof. and functioning 
under an AWS. Tbe porpoaa of tba oo- 
site studiaa la to obtain InfomatloD oo 



AWS snd not to evaulate the 
effectiveness oi s speclHc orgtnizstion 
In conducting ii^ AWS experiment. 

Dais collection methods for the on^ 
site studies will include interviews of 
employees, supervisors, snd managers: 
surveys of ssmples of employees; and 
collection of some organizational data 
such ss productivity messures. type and 
number of public service contscti. etc. 
An initial planning meeting will be held 
of 0PM stsff snd management of the 
selected organizations to discuss 
specific plans for the on-site study. 0PM 
stsff will then make three or four on site 
visits to conduct interviews and collect 
dsts during the la-month experimental 
period. 

4. Energy Study, A spedal study will 
be conducted on the net energy impsct 
of AWS. This study wUl examine 
changes in usa|e of public and private 
transportation for commuting as well as 
for reaestionsl trsvel This will be 
sccompUsbed by using a survey and 
trsvel diary from a sample of employees 
in experimenting organizatiu..'' in 
addition, data on chaiiges in building 
energy consumption will be collected 
uaing data from specific buildings as 
well ss computer models of building 
energy utilization. Hie net energy 
impact will then be analyzed from dsta 
obtained from these two sources — 
buildings and transportstion. 
Orgamzstions selected for the building 
and/or transportation segments of the 
energy study will be notified by 0PM. 

R Analytic Methodology 

This section provides an overview of 
the strategiea and techniques which will 
be used for statistical analysis of the 
dsts collected. The purpose of any 
process of data analysts is to condense 
Information contained in tbe body of 
data into a form which can be 
comprehended and interpreted. This la 
particularly critical to the AWS project 
since the purpose of the research is to 

firovids a basis for policy decisions and 
eflslstive action. 

Sometifflea this analytic process Is 
aimply used to desoibt a body of 
empirical data. In the present project it 
is important to go beyond that and 
aearcb for meaningful patterns of 
relationships among aats of varisbles. 
thst Is. to build a comprehensive picture 
of the impact of AWS on the Fsderml 
work foica. 

Tbe narrntlvt evaloatloD reports and 
oQ-alle studies will be analyzed to 
identify general treads In the results of a 
wide variety of a xpef im e n tin| 
organliatlocia. While tfala analysis will 
not be quaotltativB In nature. It will 
allow general oondostons and provide 
>nf4rK«t^ detail to the quaatltativa 



analysis of the tongltudinsi cross- 
sectionel study. 

Three types of etstisticsl procedures 
will be used to snslyze the dale 
collected in the longitudinal, cross^ 
sectionel study. They ere descriptive 
etstistics. trend snslysis. snd snalysis of 
variance. 

Tbe descriptive snslysis of the dats 
will examine the chsrscteristics of the 
distribution of escb of the independent 
and dependent vsrisbles under 
investigstion. This will be accomplished 
by using messures of central tendency 
(e.g.. mean, median) snd distributions 
and frequencies, such so the cross^ 
tsbulation of two variables. Proportions 
will be used to describe the dsts for 
discrete category variablea. 

A second type of analyaia, trend 
al^2.lysis. will consist of plotting the dsta 
pointa of relevant variablea over the 
time period of the experiment and 
Idftntifying patterns in the data. Pattema 
which mi^t be revealed are effecta of 
experience with AWS. pattema of use 
which vary by the aeaaon of the year, 
and ao on. 

The third type of atatiatlcal procedure 
to be uaed la analyaia of variance. 
Analyaia of variance allowa the 
researcher to make inferences sbout ths 
effects of independent variables on 
dependent variables. Using analysis of 
vsriance. It will be poaalble to detect 
dilTerencea in the varioua dependent 
variablea aa a reault of the different 
typea of achedulea. 

The analytic method and independent 
and dependent variablea arc given 
below for each of the reaearch 
queations. 

For moat analyaea. the level of 
analyaia is the work unit I.e.. dsta will 
be aggregated within a work unit and 
that acore %^ be uaed to represent the 
work unit A different level of analyaia 
will be used in dealing with the areaa 
Indicated below. 

1. Efficiency of Covemment 
Operations, (a) What cbangea occur in 
miaalon accomplishment and work unit 
coau? 

— Deacriptive atatiatics and trend 
analyaia of productivity meaaurea. 
turnover ratea. leave usage, accident 
ratea and coat data. 

(b) How are management tasks 
affected? What problems develop and 
bow are tbey aolvad? 

— Oescriptiva atatiatics and trend 
analyaia of aurvay data, analysis of 
diariea. 

(c) What are the effects on 
organizational climate reaulting from 
AWST 

— Analysis of variance of change 
acorca for organizational climate and 
|ob aatiafaction. 
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"-Oeicriptivi ■utiaOcs od tmd 
analjrtii of oiianizadoniil dioute. 

(d) Art riBdency aod prodvcttvltjr 
afftctod by Hm typt of AWSoMdT 

— OMcripttyi ■utMbci of tfBdncy 
and productivity neaauret a« ■ fvMllos 
of (ij work tckcduJe. \l\ work tinll 
tachDokgy. and (3) «»crk fqroe 
charactariatka. 

^Analyaif of vinance of outcoma 
oiaaaiBaa by work achrdule. 

2. Mam TtanMti Foci/itte$ and Ttaffic 
(i) It flwia a tranaponatioD advantajjc 
from AW5 for allh*r individuaU or 
pubbc truuil audiontiea^ 

— Aoalyalj of ■pecial atudy oo anergy. 

^Deiaiptive ■taiiatic« of aurvey data 
ODcommutinf babita (Uevtl of analyala: 
Individual) 

(b) What affecta do AWS bava on 
choica of ooaunutin|{ tranapoftition and 
CD conuDutlng tiine^ 

--Oeaalptivaalatianca of aurvey data 
on commuting babita aa a function of 
AWS and oiganiiabonal charadailatica. 
(Level of anaJyvta: individual) 

3. LeveU of Energy Consumptioiu (a) 
Are there energy tavm^ from 
trtnaportatioD tff«cta of AWS? 

— Analyaia of va nance on amount and 
frvquency of automobile uaage. 

(b) U there an increaae in energy 
cooiumption from building and 
aquipment uae aa a re»uJt of AWS? 

—Analyala of apeoal atudy on anargy 
oonaumptMNL 

(c) What ii the nei energy impact of 
AWS frt)m tranaportation (a, abova) and 
building (b^bove) eflecta? 

— Proiectiona of the energy coata and 
•avinga aa a funcbon of a particular 
AWS. and oiganixation characteriatica 
(particularly geographic location and 
technology). 

4. Serrice to the Public, (a) la aarvica 
to the public Inoeat^d or decrvaaed in 
quality or quantity? How much la Ilia 
gain or loaa worth? 

—Analyala of on-aite atwiy data on 
qoality of ooatainar tcrvica. 

(bl How Roch ia the change In aeivloa 
affected by lha AWS. work unlt'a 
ftmctioQ. alia, or locaboo? 

--Oatcriptiva atababca of lava! of 
cnaloBar aarvioa aa a functioo of AWa 
wofk Bit toction. aita. and locatkiD. 

^O^iportunJiimfotfiilUimeani 
^art^ium Ea^ywmnu (ai What aia tfaa 
labor aiq«^ affacta oT AWS? 

D— griptivaa atatutjoa of aaoondaiy 
data froB Baraaa of Labor Statiatlca. 

Cb) WIS thara ba naw labor fcraa 
•DtraolaT 

"^i—a^ytM ttabatica of aaooodaiy 
data froa Buiaaa of tabor SlflOatSGB. 

(c) la thara a abift frovi pait*llDM to 
Adl-tima aaployBant? 



—Trend anAJyaia of parl-tijoa^iull- 
time employaa ratio aa a fonctf on of 
AWS. 

(d) Doea moonlighting incraaaa? 

— •Daaoiptive aUtiatici of aurrcy data 
00 moooligfating. (Laval of analyala: 
^dividual) 

—Trend analyala of away data aa a 
fuiKtionof AWS. 

(e) What typaa of |oba are beat aultad 
for AWS? 

— Deacrioti va atatiatica of job 
characteriatica by AWS. where outnoma 
meaaurea (a^^ productivity, leave 
BMge. etc.] and employee aatiafacUon 
are chief vaffablea. 

(f) How do AWS affect the 
employment opportunitiea for women 
and the bandioepped? 

— Deacriptive etatiatica of employment 
and tumover ratea by aex and by 
phyalcal and mental handicap. 

— Deaoiptive atatiatica of aurvey data 
oo utilization of AWS. and attitudea 
toward AWS by aex and by pbyaical 
and mental bai»dicap. 

& Quality of Life for indmduoh and 
PamilieM, (a) How la the qaality of work 
life affededr What faaturea of woik life 
are affeded? 

— Deacriptive atatiatica and trend 
analyala of aurvey data on 
organizational climate, fob aatiafaction 
and perfonaance. (Level of axialyait: 
Individual) 

(b) How ia the quality of peraonal and 
non-work life affected? 

—Deacriptive etatiatica and tTcnd 
analyala of aurvey data on imped on 
family and peraonal life. 

(c) Do aodaL educational, or dvlc 
activltiea change? 

—Deacriptive atatiatica and trend 
analvaia of aunrfcy data on imped oo 
family and pataonal life. 

(d) Do family relationahipt and dilld 
care pattania changet 

—^acriptiva atatiatica and trend 
analyala of aorrey data oo tmpad on 
family and paraonal Hfe. 

(a) Do the effecU on quality of Ufa 
vary with the AWS uaed? 

— Analyaia of variaace with quality of 
life faclota aa dependent vaitablaa. 

Aa raqoM by Ptib. L tS^aOQ. an 
interim report oootaining 
raoommendaCtooa pertainii^ to ttia 
legialative or admlnlatrattve actioa If 
any. which aboold be taken aa a laeult 
of the AWS BxperimaBtal IVoruB will 
be opmplatod hr Saptambar aa. latL A 
final lapott agmmarl^Qg lha laauha of 
the A WS ft^avlmaBtal hvfmm win ba 
prepand by Om and aafanittad to 
the IVealdirtL lha aipaakar of the Hova. 
and the PkaaldaBt pre lampoffa €( tfaa 
Senate hfM^Wk MO. 



OIBoaef ^rtomieJ MaBegamaoL 
Bevariy ftC Icnei^ 
ittuance Syttam hieoafmr. 

Aooordiiillv, OPM la amending fi JFR 
Pari BA> aa foUowa: 

(t) Tha MMpd Ajipendix A la 
revoked. 

(2) The latartm Maatar Plan ii 
revoked. 

(Pub L »-m TItlta I and n and 
RacfganltatioB Ftan No. 2 of 107a. Sec 102) 
pre Ok. ».i«ira^ »>u-aa Ml M] 



OCPARmENT OF AORtCULTURE 

AorfciAini Marktttog Sarvte* 

7CPRPwt910 

(Lemon fleguletton 243) 

tamona Grown In CaMomla ar>d 
Aftiona; Umltatlon of Handling 

AOOiCv: A^cultural Marketing Service. 
USDA. 

AcncMc Final rule. 



Thia regulation ealabliabea 
the quantity of freab California Arizona 
lemona that mey be ahipped to market 
during the period March 16*22. 1B80. 
Such action ia needed to provide for 
orderly marfceHng of freab lemona for 
thia period dut to the marketing 
eituatioo confaontiag the lemon induatry. 
■mcnvE DATg: March 11 1080. 
poa ruHTHia MPomiAtiON cont act: 
Malvtn E. McCaha. 20^447-5075. 
•umxMorTAinr mfohmatiom: Fin<Lngs. 
Thia regulation la iaaued under the 
Bucketing agreement aa amended, and 
Order No. ^0. ea amended (7 CFR Part 
910). legulating the handling of lemona 
grown In Callforaia and Arizona. The 
agreement and order ere effective unoer 
the Agricultural Marketing Agreement 
Ad of 1037. IS amended (7 U.S.C. OQi- 
074). th/t ectioD la baaed upon the 
recommendatioaa and information 
aubmltted by the Lemon Adminlatretive 
Cofflffllttea, and apon other informati ^n. 
It la baraby found that thia ection will 
lend lo albctuata the declared policy oi 
tfaeecL 

Thia ectioD la oonalatent with the 
marketlQg noUcy for 1070-60 which wea 
dealgnatad aianlflranl under the 
pmedurea 01 Executive Order 12044. 
The maifcatlag policy wea recommended 
by the nraaaiitlae laUowiag diacuaaion 
at a paMlf>aaftot m Ny n. lOTO. A 
final faapael analyala oo the marketing 
policy la avafiafala from Malvin E. 
McCaha. fW Phdt tench. FA V. 
AM& USDA. Waahlogton. D.C lOOSa 
telephone 202-447-6075. 
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COMPONENTS OF 0PM ' S MASTER PLAN 

LONGITUDINAL AND CROSS-SECTION/^^. STUDY 

The longitudinal and cross-sectional study constitutes 
a major element in 0PM 's evaluation • The study is directed 
at collecting both objective data on the functions and char- 
acteristics of work units and subjective attitudes of employ- 
ees on their impressions and rr-^ctions to AWS. According to 
CI'M, the study is longitudinal ^n that data will be collected 
at specified times thi oughout the experiment; it is cross- 
sectional in thrt it encompasses a variety of AWS operating 
in a diverse samplin^^ of Federal acti\ ities • 

The longitudinal study will collect information on: 

— Organizational and wox^k unit characteristics. 

— Significant events whijh might affect AWS results 
within an organization, 

— Longitudinal archival data on productivity measures, 
turnover rates, leave usage, overtime r employment 
opportunities , and accident rates . 

--Employees' and supervisors' attitudes about AWS, 
Employee survey 

0PM 's master plan cal"»s for administering a question- 
naire to all employees and supervisors in certain work units 
participating in the longitudinal study. The questionnaire 
is to be administered 4 times during :he experimental period — 
at the start of the experiment and 3, 12, and 18 months after 
AWS is implemented. 

At the time of our review, 70 work units employing 
abou' 2,000 employees were participating in this phase of 
the evaluation and had been a. ^ministered the first two ques- 
tionnaires. 0PM judgmentally selected these work units on 
the basis of a number of considerations which included the 
function, activity, and technology of the work units; their 
size and location; and their willingi.ess to participate in 
the study. 

In selecting its sample and conducting the study, 0PM 
is using an experimental design consisting of four types of 
AWS — the 5-4/9 compressed schecuxe, -^he 4-da'r week compressed 
schedule, flexible schedules that aj ow variability in the 
number of hours worked per day, and schedules which require 
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employees to work 8 hours per day but allow flexibility in 
starting and quitting times. Within each of these 4 types, 
0PM selected between 15 and 19 work units. The prime consid- 
eration in the overall number of urits selected was the 
amount of infoiination which the 0PM staff felt it could ef- 
fectively handle while executing the other components of the 
master plan. 

ONSITE STUDIES 

Believing that certain types o£ data may be difficult 
to obtain on an overall, cross-sectional basis, and that 
some results may be manifest only in the presence of special 
factors, 0PM decided to include onsite studies as a segment 
of the evaluation. The objectives of these studies are to 
provide detailed data on AWS effects and to identify prob- 
lems and benefits associated with planning, implementing, 
and functioning under AWS. At the time of our review 0PM 
had initiated several of these studies and had plans to con- 
duct at least nine onsite studies in total. These studies 
will supplement the longitudinal and cross-sectional study 
and narrative reports and provide additional explanatory 
detail for 0PM *s final report. 

The results of these studies will differ from the other 
components of the evaluation because they will focus on col- 
lecting information on the effects of AWS which manifest 
themselves in larger organizational units, rather than the 
work unit or only under some special conditions. Addition- 
ally, in an attempt to isolate the effects that result from 
specific AWS, 0PM is using some comparison groups consisting 
of units not participating in the AWS experiment. 

0PM plans to conduct most of the onsite studies at mul- 
tiple locations for each organization. 0PM believes these 
studies will allow it to collect data in greater detail and 
to focus on problems encountered, management issues, and the 
pethods by which both organizations and individuals cope 
with the changes and problems resulting from AWS implementa- 
tion. 

Selection criteria 

The organizations and locations included in the onsite 
studies were selected judgmentally by 0PM using a combina- 
tion of criteria. Selection criteria included a variety of 
AVJS types, types of activities, geographic locations, and ex- 
pression of willingness to participate in the onsite studies. 
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Distinguishing features of the organizations, such as avail- 
ability of historical productivity data and adoption of a 
specific AWS to meet a unique organizational objective, were 
also used as criteria. 

Technical approach 

No one research design or approach is being used for 
all onsite studies. 0PM is custom designing each study on 
the basis of objectives, characteristics of the organiza- 
tions, and availability of needed data. The data collection 
techniques for each study include: 

— Administration of the longitudinal employee survey. 

— Interviews with key managers and AWS project managers 
or coordinators. 

— Collection of needed data m organization records. 

NARRATIVE REPORTS 

0PM' s master plan requires each work unit experimenting 
with AWS, which is not participating in the longitudinal and 
cross-sectional, onsite, or special energy studies, to pre- 
pare a narrative report by May 1, 1981, detailing its ex- 
periences with, and the effects of, AWS. The reports are to 
be prepared as nontechnical summary assessments. The master 
plan stipulates that the reports must include information on 
the effects of AWS on the six impact areas identified in the 
act. The plan further provides that both management and 
local labor unions involved in the individual experiments 
should provide input in developing and preparing the narra- 
tive reports. Additionally, the results of any formal in- 
ternal evaluations which organizations conduct are to be 
included in the reports. 

Although 0PM has provided no specific guidance on how 
the individual assessments should be conducted, it has pro- 
vided a general outline of information to make reports from 
different organizations uniform. 

In addition to information relating to the six impact 
areas, the reports are to include information on organiza- 
tional characteristics and special problems which developed 
during the experiment, such as a large number of requests 
for exclusions due to hardships, difficulties experienced in 
administering pay and leave, and overtime or manpower prob- 
lems during peak workload periods. 




APPENDIX IV 



APPENDIX IV 



On the basis of the number of work units presently ex- 
perimenting, 0PM should receive approximately 1,300 narra- 
tive reports. Using these reports, 0PM hopes to draw conclu- 
sions about the effects of AWS, special problems encountered 
in using it, and the variations of AWS used. At the time of 
our review the procedure for analyzing the reports had not 
been developed. 

ENERGY STUDY 

The special study on net energy impact will provide 
data on the AWS effects on transportation and on building 
operating costs. The study will examine the changes in 
using public and private transportation for commuting as 
well as recreational travel . 

The study will be accomplished by administering a ques- 
tionnaire on commuting practices to between 1,300 and 1,500 
employees. The same individuals are also being requested to 
maintain a 1-week diary, or trip log, which details the 
amount and purpose of individual vehicle usage. 

The questionnaire will be administered and the trip log 
prepared three times during the experimental period. Al- 
though approximately the same number of individuals froiu the 
same work units will be requested to complete the question- 
naire and trip log, the exact same individuals will not nec- 
essarily be the respondents all three times. At the time of 
our review, the questionnaire and trip log had been completed 
once. 

Information on changes in building energy consumption 
will be collected using data from specific buildings. 0PM 
plans to use the building and transportation energy consump- 
tion data to assess the net energy effect of AWS. 
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United States of America 

Office of 

Personnel Management Washington, d.c. 20415 

'AU6 -ib 1880 

tn fWpty fUter To Your R«««r«T)c« 



Mr. H. L. Krieger 
Director, Federal Personnel 
and Compensation Division 
U.S. General Accounting Office 
Washington, D. C. 20548 




We have reviewed your report on the Alternative Work Schedules Experiment 
and offer the following comments and observations. 

^ We generally agree with your finding that limitations on resources have made 
more difficult the job of Implementing and evaluating an experiment of this 
size. However, for the reasons outlined below, we do not agree with GAO 
that "the current study will fail to provide the degree of valid and reliable 
information necessary for the Congress to make a knowledgeable decision on 
permanent legislation" and we certainly do not understand why GAO would 
recommend that 0PM take money from activities funded by the Congress to in- 
crease the resources for AWS when the Congress specifically reduced the funds 
for that project, [see GAD note 1, p. 64.] 

Within the resources assigned to the project, we have attempted to deal with 
the problems you have identified. For example, 0PM is verifying the data 
files containing information on each experiment as rapidly as possible with 
the available staff. Several variables identified as necessary such as the 
goals of the experiments, timekeeping procedures, use of credit hours, and 
the degree of employee flexibility in using the AWS will be incorporated in 
future guidance regarding preparation of the narrative reports. The addition 
of these variables to the information being requested in the narrative reports 
will provide much of the valid information you have suggested as necessary for 
Informed decision-making. 

0PM also fully intends to employ multivariate analysis when we analyze these 
narrative reports. Since these reports will be from all organizations experi- 
menting (except those in one of the other AWS studies), they will be repre- 
sentative of the population of AWS users in the Federal Government. [See 
GAD note 2, p. 64.] 

Control groups are being utilized to the maximum extent possible within the 
constraints of available resources. The effects of AWS on service to the 
public is being addressed in those experimental sites which deal directly 
with the public. In addition, the employee survey is being revised to 
include items on employee reactions to and experiences with AWS. 
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Based on the above changes, we believe the current AWS evaluation being 
conducted by 0PM will provide sufficient minimum valid information on the 
effects of AWS in Federal agencies for the Congress to make an informed 
decision on modification of current work hours legislation. We certainly 
sympathize with the arguments for a more comprehensive study but, as the GAO 
report notes, we funded such an effort in the President's Fiscal Year 1980 
budget, and the funding was reduced by the Congress, 

With respect to your comments on the sampling procedure we employed in the 
longitudinal and cross-sectional study, it must be noted that the sampling 
plan which we used was selected for pragmatic reasons. These reasons included 
our recognition of the funding limitations for the project and the reporting 
requirements burden to the agencies. Because of the voluntary nature of the 
program, any sampling technique will only reflect the effects of AWS in that 
portion of the Federal workforce which adopts an AWS experiment. We do not 
share GAO s concern about broadening the base to include agencies or units 
not desiring AWS, since it is our view that AWS should not be a Government-wide 
mandatory program, but rather an option available to the agencies when they 
and their employees both agree that AWS makes sense for them. In our view 
the current evaluation will present a representative picture of the effects 
of AWS on the affected workforce, [gee GAO note 3, p. 65.] 

We also disagree with your report in describing OPM's methodology for determining 
the number of employees on a flexible schedule as a "technical error." A 
flexible schedule allows an employee to select his/her starting time. Because 
someone happens to choose the same starting time as the organization might have 
had under fixed hours does not negate the employee's option of later choosing 
a different starting time. To follow the GAO suggestion of not considering 
employees who choose the "traditional work schedule" as under the experiment 
would create s^>veral administrative problems. For' example, the number of 
people in the experiment would vary on a daily, weekly, etc., basis depending 
on the number who chose the "traditional schedule." The premium pay rules to 
be used would be confusing; either the permanent provision of title 5 for those 
working traditional hours" or those provisions of Public Law 95-390 for em- 
ployees who vary their schedule by any amount from the "traditional hours." 
The result could be inconsistent de.ta. [see GAD note 4, p. 65.] 

"ij summary, although current funding does not a: low us to conduct and evaluate 
the experiment as extensively as we had originally planned, we believe our 
updated evaluation pleia will provide meaningful decision^naking information. 
[See GAO note 5, p. 65.] /O 

S^ficerely yours. 





. Nelson 
ate Director 
for Compensation 
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AGENCY COMMENTS 
GAO note 1 . 

This recommendation is consistent with the views of the 
House and Senate Appropriations Committees- In denying 0PM 
its supplemental request for fiscal year 1979 and in reduc- 
ing the fiscal year 1980 request, the committees indicated 
that 0PM should be able to fund the alternative work sched- 
ules project with moneys already appropriated. In consider- 
ing the fiscal year 1979 supplemental request, the House 
Committee also stated that 0PM should be able to fund the 
project with funds already appropriated "if the program is 
of sufficiently high priority. " 

At no time was there any indication that the scope or 
quality of the experiment and evaluation should be reduced — 
only that 0PM should fund the project internally. If after 
assessing its priorities, 0PM could not reallocate the 
needed budgeted funds, it should have worked with the respec- 
tive congressional committees to discuss its priorities and 
to inform them of the tradeoffs in quality and reliability 
which would result from an altered evaluation. 

GAO note 2 . 

An 0PM official indicated that the decision to gather 
the additional information for the narrative reports and to 
use multivariate analysis resulted from our suggestions dur-^ 
ing the review. While 0PM 's action is a positive effort to 
improve its evaluation, we believe serious problems still 
exist with the narrative reports. While work units have 
been instructed on the format and content of the reports, 
the method of analysis is being left to their discretion. 
Also, 0PM has not specified the evaluation criteria (i.e., 
what constitutes a positive or negative effect) or the im- 
portance of the criteria. 

If 'mplcmented, many of the other recommendations in- 
cluded chapter 4 could improve the usefulness of the nar- 
rative reports. As with other components of the evaluation, 
0PM 's highest priority should be to reassess the entire nar- 
rative report. It is especially crucial that 0PM specify, 
in advance, the objectives and how the information will be 
analyzed and interpreted. Otherwise, 0PM will gather addi- 
tional information which it is not equipped to review and 
analyze adequately. 
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GAO note 3 . 

We agree with 0PM that AWS should not be a Government- 
wide mandatory program. 0PM fails to recognize, however, 
that individuals who are not experimenting with AWS, whether 
by choice or not, may be affected by it. For example, while 
employees using a compressed or flexible schedule might in- 
dicate that their productivity and morale have increased, 
individuals within the same or another unit not using an al- 
ternative schedule may be adversely affected by decreased 
communication possibilities or by having to perform other 
individuals* functions when they are absent. Therefore, we 
believe that using control (i.e., comparison) groups to the 
maximum degree possible is desirable. 

In administering the employee questionnaires, 0PM has 
not differentiated between those respondents who are, and 
who are not, using an alternative work schedule. This repre- 
sents just one of the many variables which we believe must 
be considered and adjusted for in evaluating the experiment. 

GAO note 4 1 

In describing 0PM ' s method for determining the number 
of employees using a flexible schedule as a "technical error," 
we were referring only to evaluation. While by definition, 
employees within a unit using a flexible work schedule are 
considered participants for purposes of administering the 
provisions of the act and 0PM ' s regulations, 0PM must, in our 
view, determine whether individuals have actually altered 
their work schedules for purposes of evaluation. The reac- 
tions of these individuals and the potential biases must be 
considered in assessing the evaluation results. An attempt 
should also be made to determine why these individuals have 
not altered their schedules. For example, individuals who, 
because of personal preference, choose not to alter their 
work schedule may react differently to AWS than individuals 
who cannot alter their schedule for reasons beyond their 
control (e.g., mass transit schedules and availability). 

GAO note 5 . 

While 0PM ' s evaluation will result in the collection of 
a mass of data, we have little confidence in the validity 
and reliability of the ultimate results. We believe that 
the emphasis should be placed on executing a well-planned 
and designed evaluation which maximizes experimental control 
and produces quality results rather than simply quantity. 
Because the results of this experiment may have substantial 
cost implications for the Government and on the work habits 
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of all Federal employees, we believe it is essential that a 
quality experiment and evaluation be conducted, which will 
result in the valid and reliable information the Congress 
needs to make an informed decision. The decision will ulti- 
mately have far-reaching and long-term effects on the Fed- 
eral Government and may dictate the future for increased 
experimentation in the private sector. If there are substan 
tial cost benefits which can be realized from using AWS, the 
evaluation must be a quality one and must yield valid and 
reliable results to minimize criticism from AWS opponents. 
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